Nov 06 10:33:12 devstack cinder-volume[75741]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 10:33:12 devstack cinder-volume[75741]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 10:33:12 devstack cinder-volume[75741]: we strongly recommend against using it for new projects. Nov 06 10:33:12 devstack cinder-volume[75741]: If you are already using Eventlet, we recommend migrating to a different Nov 06 10:33:12 devstack cinder-volume[75741]: framework. For more detail see Nov 06 10:33:12 devstack cinder-volume[75741]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 10:33:12 devstack cinder-volume[75741]: import eventlet # noqa Nov 06 10:33:15 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 10:33:15 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 10:33:15 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 10:33:16 devstack cinder-volume[75741]: INFO dbcounter [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Registered counter for database cinder Nov 06 10:33:16 devstack cinder-volume[75741]: DEBUG oslo_db.sqlalchemy.engines [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 10:33:16 devstack cinder-volume[75741]: DEBUG dbcounter [-] [75741] Writer thread running {{(pid=75741) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 10:33:16 devstack cinder-volume[75741]: INFO cinder.rpc [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 10:33:16 devstack cinder-volume[75741]: INFO cinder.rpc [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 10:33:16 devstack cinder-volume[75741]: DEBUG oslo_db.sqlalchemy.engines [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 10:33:16 devstack cinder-volume[75741]: INFO cinder.volume.manager [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Determined volume DB was empty at startup. Nov 06 10:33:16 devstack cinder-volume[75741]: DEBUG cinder.volume.manager [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75741) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 10:33:16 devstack cinder-volume[75741]: INFO cinder.volume.manager [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 10:33:16 devstack cinder-volume[75741]: WARNING stevedore.named [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 10:33:16 devstack cinder-volume[75741]: WARNING castellan.key_manager [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 10:33:16 devstack cinder-volume[75741]: WARNING cinder.keymgr.conf_key_mgr [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 10:33:16 devstack cinder-volume[75741]: DEBUG cinder.volume.drivers.lvm [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75741) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 06 10:33:16 devstack cinder-volume[75741]: DEBUG oslo_concurrency.processutils [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75741) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_concurrency.processutils [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] CMD "cinder-rtstool verify" returned: 0 in 0.379s {{(pid=75741) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_db.sqlalchemy.engines [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 10:33:17 devstack cinder-volume[75741]: INFO cinder.rpc [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 06 10:33:17 devstack cinder-volume[75741]: INFO cinder.rpc [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 06 10:33:17 devstack cinder-volume[75741]: WARNING stevedore.named [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 10:33:17 devstack cinder-volume[75741]: WARNING castellan.key_manager [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 10:33:17 devstack cinder-volume[75741]: INFO cinder.volume.manager [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_db.sqlalchemy.engines [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 10:33:17 devstack cinder-volume[75741]: INFO oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Starting 1 workers Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Started child 75901 {{(pid=75741) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Full set of CONF: {{(pid=75741) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] ******************************************************************************** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Configuration options gathered from: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] ================================================================================ {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] allow_availability_zone_fallback = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] allow_compression_on_image_upload = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] allowed_direct_url_schemes = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] api_rate_limit = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] auth_strategy = keystone {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] az_cache_duration = 3600 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_availability_zone = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_host = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_stats_polling_interval = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backup_api_class = cinder.backup.api.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backup_name_template = backup-%s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backup_use_same_host = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backup_use_temp_snapshot = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] chap_password = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] chap_username = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cinder_internal_tenant_project_id = 4356d1caa57848de865f6be412ba413f {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cinder_internal_tenant_user_id = c5cb000509d74019a17b91c97299284a {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cloned_volume_same_az = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cluster = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] compression_format = gzip {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] compute_api_class = cinder.compute.nova.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] config_dir = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] config_source = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] control_exchange = openstack {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] debug = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] default_availability_zone = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] default_group_type = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] default_volume_type = lvmdriver-1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] disk_geometry = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] driver_client_cert = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] driver_client_cert_key = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] driver_data_namespace = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] driver_ssl_cert_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] driver_ssl_cert_verify = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] driver_use_ssl = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] enable_force_upload = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] enable_new_services = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] enable_unsupported_driver = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75901]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] enforce_multipath_for_image_xfer = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] filter_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance_api_insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance_api_servers = ['http://192.168.122.176/image'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance_api_ssl_compression = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance_ca_certificates_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance_catalog_info = image:glance:publicURL {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance_certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance_keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance_num_retries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance_request_timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] goodness_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] graceful_shutdown_timeout = 5 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] group_api_class = cinder.group.api.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] host = devstack {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] image_compress_on_upload = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] image_conversion_address_space_limit = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] image_conversion_cpu_limit = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] image_conversion_disable = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] image_introspection_address_space_limit = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] image_introspection_cpu_limit = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] image_upload_use_cinder_backend = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] image_upload_use_internal_tenant = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] image_volume_cache_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] image_volume_cache_max_count = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] image_volume_cache_max_size_gb = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] init_host_max_objects_retrieval = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] instance_format = [instance: %(uuid)s] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] iscsi_target_flags = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] iscsi_write_cache = on {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] iser_helper = tgtadm {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] iser_ip_address = 192.168.122.176 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] iser_port = 3260 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] log_color = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] log_config_append = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] log_dir = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] log_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] log_options = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] log_rotate_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] log_rotate_interval_type = days {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] log_rotation_type = none {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] max_age = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] max_logfile_count = 30 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] max_logfile_size_mb = 200 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] max_over_subscription_ratio = 20.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] message_reap_interval = 86400 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] message_ttl = 2592000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] migration_create_volume_timeout_secs = 300 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] monkey_patch = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] monkey_patch_modules = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] my_ip = 192.168.122.176 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] no_snapshot_gb_quota = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] num_iser_scan_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] num_shell_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] num_volume_device_scan_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] nvmeof_conn_info_version = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] nvmet_ns_id = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] nvmet_port_id = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] osapi_max_limit = 1000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] osapi_volume_ext_list = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] osapi_volume_listen_port = 8776 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] osapi_volume_use_ssl = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] osapi_volume_workers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] per_volume_size_limit = -1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] periodic_fuzzy_delay = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] periodic_interval = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] public_endpoint = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] publish_errors = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] quota_backup_gigabytes = 1000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] quota_backups = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] quota_gigabytes = 1000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] quota_groups = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] quota_snapshots = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] quota_volumes = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] rate_limit_burst = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] rate_limit_except_level = CRITICAL {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] rate_limit_interval = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] reinit_driver_count = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] replication_device = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] report_discard_supported = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] report_interval = 120 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] reservation_clean_interval = 86400 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] reservation_expire = 86400 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] reserved_image_namespaces = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] reserved_percentage = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] rpc_response_timeout = 120 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] run_external_periodic_tasks = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] scst_target_driver = iscsi {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] scst_target_iqn_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] service_down_time = 720 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] shell_completion = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] snapshot_name_template = snapshot-%s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] snapshot_same_host = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] split_loggers = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] state_path = /opt/stack/data/cinder {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] storage_availability_zone = nova {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] storage_protocol = iSCSI {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] syslog_log_facility = LOG_USER {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] target_helper = lioadm {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] target_ip_address = 192.168.122.176 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] target_port = 3260 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] target_protocol = iscsi {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] target_secondary_ip_addresses = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] trace_flags = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] transport_url = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] until_refresh = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] use_chap_auth = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] use_default_quota_class = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] use_journal = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] use_json = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] use_multipath_for_image_xfer = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] use_stderr = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] use_syslog = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] verify_glance_signatures = enabled {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] volume_api_class = cinder.volume.api.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] volume_backend_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] volume_clear = zero {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] volume_clear_ionice = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] volume_clear_size = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] volume_copy_bps_limit = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] volume_dd_blocksize = 1M {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] volume_name_template = volume-%s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] volume_service_inithost_offload = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] volume_usage_audit_period = month {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] zoning_mode = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_concurrency.disable_process_locking = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.auth_section = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.auth_type = password {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.auth_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.cache = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.include_service_catalog = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.interface = public {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_password = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcache_username = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.region_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.service_type = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.176/identity {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.backend = dogpile.cache.null {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.backend_argument = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.backend_expiration_time = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.config_prefix = cache.oslo {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.debug_cache_backend = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.enable_retry_client = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.enable_socket_keepalive = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.expiration_time = 600 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.hashclient_retry_attempts = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.memcache_dead_retry = 300 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75901]: INFO cinder.volume.manager [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.memcache_pool_maxsize = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.memcache_sasl_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.password = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.proxies = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.redis_db = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.redis_server = localhost:6379 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.retry_attempts = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.retry_delay = 0.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.socket_keepalive_count = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.socket_keepalive_idle = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.socket_keepalive_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.socket_timeout = 1.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.tls_allowed_ciphers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.tls_cafile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.tls_certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.tls_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.tls_keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cache.username = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] coordination.backend_url = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.asyncio_connection = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.asyncio_slave_connection = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.backend = sqlalchemy {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.connection = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.connection_debug = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.connection_parameters = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.connection_recycle_time = 3600 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.connection_trace = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.db_inc_retry_interval = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.db_max_retries = 20 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.db_max_retry_interval = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.db_retry_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.max_overflow = 50 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.max_pool_size = 5 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.max_retries = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.mysql_wsrep_sync_wait = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.pool_timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.retry_interval = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.slave_connection = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.sqlite_synchronous = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.synchronous_reader = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] database.use_db_reconnect = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_tracing.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] profiler.connection_string = messaging:// {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] profiler.enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] profiler.es_doc_type = notification {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] profiler.es_scroll_size = 10000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] profiler.es_scroll_time = 2m {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] profiler.filter_error_trace = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] profiler.hmac_keys = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] profiler.sentinel_service_name = mymaster {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] profiler.socket_timeout = 0.1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] profiler.trace_requests = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] profiler.trace_sqlalchemy = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] profiler_jaeger.process_tags = {} {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] profiler_jaeger.service_name_prefix = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] profiler_otlp.service_name_prefix = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_policy.enforce_new_defaults = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_policy.policy_default_rule = default {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_policy.policy_file = policy.yaml {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] privsep_osbrick.group = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] privsep_osbrick.helper_command = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] privsep_osbrick.user = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cinder_sys_admin.group = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cinder_sys_admin.helper_command = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] cinder_sys_admin.user = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] service_user.auth_section = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] service_user.auth_type = password {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] service_user.cafile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] service_user.certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] service_user.collect_timing = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] service_user.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] service_user.keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] service_user.send_service_user_token = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] service_user.split_loggers = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] service_user.timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] service_user.tls_ciphers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] service_user.tls_min_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance.auth_section = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance.auth_type = password {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance.certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance.collect_timing = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance.keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance.region_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance.split_loggers = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance.timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance.tls_ciphers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] glance.tls_min_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.backend_availability_zone = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.chap_password = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.chap_username = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.disk_geometry = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.driver_client_cert = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.driver_client_cert_key = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.driver_data_namespace = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.driver_use_ssl = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.extra_capabilities = {} {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.filter_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.goodness_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.iscsi_target_flags = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.iscsi_write_cache = on {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.iser_helper = tgtadm {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.iser_ip_address = 192.168.122.176 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.iser_port = 3260 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.lvm_share_target = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.lvm_type = auto {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.num_shell_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.replication_device = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.report_discard_supported = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.reserved_percentage = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.target_helper = tgtadm {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.target_ip_address = 192.168.122.176 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.target_port = 3260 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.target_protocol = iscsi {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.trace_flags = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.unique_fqdn_network = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.use_chap_auth = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.volume_backend_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.volume_clear = zero {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.volume_clear_ionice = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.volume_clear_size = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_reports.file_event_handler = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_reports.log_dir = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.backend_host = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.chap_password = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.chap_username = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.disk_geometry = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.driver_client_cert = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.extra_capabilities = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.filter_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.goodness_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.iser_helper = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.iser_ip_address = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.iser_port = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.lvm_share_target = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.lvm_type = auto {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.num_shell_tries = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.replication_device = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.report_discard_supported = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.reserved_percentage = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.scst_target_driver = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.storage_protocol = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.target_helper = lioadm {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.target_ip_address = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.target_port = 3260 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack sudo[75906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.trace_flags = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.use_chap_auth = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack sudo[75906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.volume_clear = zero {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.volume_clear_size = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] lvmdriver-1.volumes_dir = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.ssl = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_notifications.driver = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_notifications.retry = -1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] key_manager.fixed_key = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.barbican_api_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.barbican_endpoint = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.barbican_endpoint_type = public {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.barbican_region_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.cafile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.collect_timing = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.number_of_retries = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.retry_delay = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.send_service_user_token = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.split_loggers = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.tls_ciphers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.tls_min_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.verify_ssl = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican.verify_ssl_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican_service_user.auth_section = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican_service_user.auth_type = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican_service_user.cafile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican_service_user.certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican_service_user.collect_timing = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican_service_user.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican_service_user.keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican_service_user.split_loggers = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican_service_user.timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican_service_user.tls_ciphers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] barbican_service_user.tls_min_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vault.approle_role_id = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vault.approle_secret_id = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vault.auth_method = approle {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vault.auth_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vault.kv_mountpoint = secret {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vault.kv_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vault.kv_version = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vault.namespace = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vault.root_token_id = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vault.ssl_ca_crt_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vault.timeout = 60.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vault.token_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vault.token_role = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vault.use_ssl = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:33:17 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] ******************************************************************************** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 10:33:18 devstack sudo[75906]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:18 devstack sudo[75909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 10:33:18 devstack sudo[75909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:18 devstack sudo[75909]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.287s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:33:18 devstack cinder-volume[75901]: INFO cinder.brick.local_dev.lvm [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 06 10:33:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:18 devstack sudo[75947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 10:33:18 devstack sudo[75947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:18 devstack sudo[75947]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:18 devstack cinder-volume[75901]: DEBUG cinder.brick.local_dev.lvm [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75901) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 06 10:33:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:18 devstack sudo[76072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 10:33:18 devstack sudo[76072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:19 devstack sudo[76072]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:19 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.502s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:19 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:19 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:19 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:19 devstack sudo[76257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 10:33:19 devstack sudo[76257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:19 devstack sudo[76257]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:19 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:19 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:19 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:19 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:19 devstack sudo[76344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 06 10:33:19 devstack sudo[76344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:19 devstack sudo[76344]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:19 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.273s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:19 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:19 devstack sudo[76433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 10:33:19 devstack sudo[76433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:20 devstack sudo[76433]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:20 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:20 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:20 devstack sudo[76520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 10:33:20 devstack sudo[76520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:20 devstack sudo[76520]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:20 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:20 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:20 devstack sudo[76523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 10:33:20 devstack sudo[76523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:20 devstack sudo[76523]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:20 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.369s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:20 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:20 devstack sudo[76608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 10:33:20 devstack sudo[76608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:20 devstack sudo[76608]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:20 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:20 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:21 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:21 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:21 devstack sudo[76624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 10:33:21 devstack sudo[76624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:21 devstack sudo[76624]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:21 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:21 devstack cinder-volume[75901]: INFO cinder.volume.drivers.lvm [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 06 10:33:21 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:21 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:21 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:21 devstack sudo[76708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 10:33:21 devstack sudo[76708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:21 devstack sudo[76708]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:21 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:21 devstack cinder-volume[75901]: DEBUG cinder.volume.drivers.lvm [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Updating volume stats {{(pid=75901) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 10:33:21 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:21 devstack sudo[76711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 10:33:21 devstack sudo[76711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:21 devstack sudo[76711]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:21 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:21 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:21 devstack sudo[76714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 10:33:21 devstack sudo[76714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:22 devstack sudo[76714]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:22 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:22 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:22 devstack sudo[76717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 10:33:22 devstack sudo[76717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:22 devstack sudo[76717]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:22 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.241s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:22 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:22 devstack sudo[76720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 10:33:22 devstack sudo[76720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:22 devstack sudo[76720]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:22 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:22 devstack cinder-volume[75901]: INFO cinder.volume.driver [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 10:33:22 devstack cinder-volume[75901]: DEBUG cinder.volume.driver [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75901) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 10:33:22 devstack cinder-volume[75901]: DEBUG oslo_db.sqlalchemy.engines [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75901) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 10:33:22 devstack cinder-volume[75901]: DEBUG dbcounter [-] [75901] Writer thread running {{(pid=75901) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 10:33:22 devstack cinder-volume[75901]: DEBUG cinder.db.api [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Building query based on filter {{(pid=75901) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3918}} Nov 06 10:33:22 devstack cinder-volume[75901]: DEBUG cinder.image.image_utils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75901) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 10:33:22 devstack cinder-volume[75901]: INFO cinder.keymgr.migration [None req-b0bf2ae3-2737-4f11-9962-6856fa874830 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 10:33:22 devstack cinder-volume[75901]: DEBUG cinder.volume.drivers.lvm [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Updating volume stats {{(pid=75901) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 10:33:22 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:22 devstack sudo[76724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 10:33:22 devstack sudo[76724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:22 devstack sudo[76724]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:22 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:22 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:23 devstack sudo[76727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 10:33:23 devstack sudo[76727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:23 devstack sudo[76727]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:23 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:23 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:23 devstack sudo[76730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 10:33:23 devstack sudo[76730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:23 devstack sudo[76730]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:23 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:23 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:23 devstack sudo[76736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 10:33:23 devstack sudo[76736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:23 devstack sudo[76736]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:23 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:23 devstack cinder-volume[75901]: DEBUG cinder.manager [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Notifying Schedulers of capabilities ... {{(pid=75901) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:33:23 devstack cinder-volume[75901]: INFO cinder.volume.manager [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Driver initialization completed successfully. Nov 06 10:33:23 devstack cinder-volume[75901]: INFO cinder.manager [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Initiating service 2 cleanup Nov 06 10:33:23 devstack cinder-volume[75901]: INFO cinder.manager [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Service 2 cleanup completed. Nov 06 10:33:23 devstack cinder-volume[75901]: DEBUG cinder.service [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Creating RPC server for service cinder-volume {{(pid=75901) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 10:33:23 devstack cinder-volume[75901]: DEBUG cinder.service [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75901) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 10:33:23 devstack cinder-volume[75901]: INFO cinder.volume.manager [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 06 10:33:23 devstack cinder-volume[75901]: DEBUG cinder.volume.drivers.lvm [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Updating volume stats {{(pid=75901) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 10:33:23 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:24 devstack sudo[76739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 10:33:24 devstack sudo[76739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:24 devstack sudo[76739]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:24 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:24 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:24 devstack sudo[76746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 10:33:24 devstack sudo[76746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:24 devstack sudo[76746]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:24 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:24 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:24 devstack sudo[76749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 10:33:24 devstack sudo[76749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:24 devstack sudo[76749]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:24 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:24 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:33:24 devstack sudo[76753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 10:33:24 devstack sudo[76753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:33:25 devstack sudo[76753]: pam_unix(sudo:session): session closed for user root Nov 06 10:33:25 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:33:25 devstack cinder-volume[75901]: INFO cinder.volume.manager [None req-2a461446-f7bd-4e8a-a69a-f9eb95098449 None None] Driver post RPC initialization completed successfully. Nov 06 10:33:27 devstack cinder-volume[75741]: DEBUG dbcounter [-] [75741] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75741) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:33:35 devstack cinder-volume[75901]: DEBUG dbcounter [-] [75901] Writing DB stats cinder:SELECT=3 {{(pid=75901) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:33:35 devstack cinder-volume[75901]: DEBUG dbcounter [-] [75901] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75901) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:34:18 devstack cinder-volume[75901]: DEBUG oslo_service.periodic_task [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75901) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:34:18 devstack cinder-volume[75901]: DEBUG cinder.volume.drivers.lvm [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Updating volume stats {{(pid=75901) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 10:34:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:34:18 devstack sudo[78648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 10:34:18 devstack sudo[78648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:34:18 devstack sudo[78648]: pam_unix(sudo:session): session closed for user root Nov 06 10:34:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:34:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:34:18 devstack sudo[78651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 10:34:18 devstack sudo[78651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:34:18 devstack sudo[78651]: pam_unix(sudo:session): session closed for user root Nov 06 10:34:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:34:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:34:18 devstack sudo[78654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 10:34:18 devstack sudo[78654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:34:18 devstack sudo[78654]: pam_unix(sudo:session): session closed for user root Nov 06 10:34:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:34:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:34:18 devstack sudo[78657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 10:34:18 devstack sudo[78657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:34:19 devstack sudo[78657]: pam_unix(sudo:session): session closed for user root Nov 06 10:34:19 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:34:19 devstack cinder-volume[75901]: DEBUG cinder.manager [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Notifying Schedulers of capabilities ... {{(pid=75901) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:34:19 devstack cinder-volume[75901]: DEBUG oslo_service.periodic_task [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running periodic task VolumeManager._thread_info {{(pid=75901) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:34:19 devstack cinder-volume[75901]: DEBUG cinder.volume.manager [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] thread count: 6 {{(pid=75901) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:34:19 devstack cinder-volume[75901]: DEBUG cinder.volume.manager [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] thread info: [<_MainThread(MainThread, started 134232183472256)>, , , , , ] {{(pid=75901) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:35:18 devstack cinder-volume[75901]: DEBUG oslo_service.periodic_task [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75901) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:35:18 devstack cinder-volume[75901]: DEBUG cinder.volume.drivers.lvm [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Updating volume stats {{(pid=75901) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 10:35:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:35:18 devstack sudo[81941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 10:35:18 devstack sudo[81941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:35:18 devstack sudo[81941]: pam_unix(sudo:session): session closed for user root Nov 06 10:35:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:35:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:35:18 devstack sudo[81944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 10:35:18 devstack sudo[81944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:35:18 devstack sudo[81944]: pam_unix(sudo:session): session closed for user root Nov 06 10:35:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:35:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:35:18 devstack sudo[81951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 10:35:18 devstack sudo[81951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:35:18 devstack sudo[81951]: pam_unix(sudo:session): session closed for user root Nov 06 10:35:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:35:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:35:18 devstack sudo[81959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 10:35:18 devstack sudo[81959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:35:19 devstack sudo[81959]: pam_unix(sudo:session): session closed for user root Nov 06 10:35:19 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:35:19 devstack cinder-volume[75901]: DEBUG cinder.manager [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Notifying Schedulers of capabilities ... {{(pid=75901) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:35:35 devstack cinder-volume[75901]: DEBUG dbcounter [-] [75901] Writing DB stats cinder:SELECT=1 {{(pid=75901) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:35:35 devstack cinder-volume[75901]: DEBUG dbcounter [-] [75901] Writing DB stats cinder:UPDATE=1 {{(pid=75901) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:36:18 devstack cinder-volume[75901]: DEBUG oslo_service.periodic_task [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75901) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:36:18 devstack cinder-volume[75901]: DEBUG cinder.volume.drivers.lvm [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Updating volume stats {{(pid=75901) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 10:36:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:36:18 devstack sudo[84025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 10:36:18 devstack sudo[84025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:36:18 devstack sudo[84025]: pam_unix(sudo:session): session closed for user root Nov 06 10:36:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:36:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:36:18 devstack sudo[84036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 10:36:18 devstack sudo[84036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:36:18 devstack sudo[84036]: pam_unix(sudo:session): session closed for user root Nov 06 10:36:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:36:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:36:18 devstack sudo[84042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 10:36:18 devstack sudo[84042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:36:18 devstack sudo[84042]: pam_unix(sudo:session): session closed for user root Nov 06 10:36:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:36:18 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:36:18 devstack sudo[84060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 10:36:18 devstack sudo[84060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:36:19 devstack sudo[84060]: pam_unix(sudo:session): session closed for user root Nov 06 10:36:19 devstack cinder-volume[75901]: DEBUG oslo_concurrency.processutils [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75901) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:36:19 devstack cinder-volume[75901]: DEBUG cinder.manager [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Notifying Schedulers of capabilities ... {{(pid=75901) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:36:19 devstack cinder-volume[75901]: DEBUG oslo_service.periodic_task [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] Running periodic task VolumeManager._thread_info {{(pid=75901) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:36:19 devstack cinder-volume[75901]: DEBUG cinder.volume.manager [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] thread count: 6 {{(pid=75901) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:36:19 devstack cinder-volume[75901]: DEBUG cinder.volume.manager [None req-463c0b59-83bd-471d-9887-8cf532574079 None None] thread info: [<_MainThread(MainThread, started 134232183472256)>, , , , , ] {{(pid=75901) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:37:35 devstack cinder-volume[75901]: DEBUG dbcounter [-] [75901] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75901) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:37:44 devstack cinder-volume[75741]: INFO oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Caught SIGTERM, stopping children Nov 06 10:37:44 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Acquiring lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 10:37:44 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Acquired lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 10:37:44 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Releasing lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 10:37:44 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Stop services. {{(pid=75741) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 10:37:44 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Killing children. {{(pid=75741) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 10:37:44 devstack cinder-volume[75741]: INFO oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Waiting on 1 children to exit Nov 06 10:37:48 devstack cinder-volume[75901]: DEBUG oslo_concurrency.lockutils [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Acquiring lock "singleton_lock" {{(pid=75901) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 10:37:48 devstack cinder-volume[75901]: DEBUG oslo_concurrency.lockutils [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Acquired lock "singleton_lock" {{(pid=75901) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 10:37:48 devstack cinder-volume[75901]: DEBUG oslo_concurrency.lockutils [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Releasing lock "singleton_lock" {{(pid=75901) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 10:37:48 devstack cinder-volume[75901]: WARNING amqp [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 10:37:49 devstack cinder-volume[75901]: WARNING amqp [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 10:37:49 devstack cinder-volume[75741]: INFO oslo_service.backend._eventlet.service [None req-27a2fd5a-e8c7-420b-a1e5-43ed53a027c4 None None] Child 75901 exited with status 0 Nov 06 10:37:49 devstack cinder-volume[85976]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 10:37:49 devstack cinder-volume[85976]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 10:37:49 devstack cinder-volume[85976]: we strongly recommend against using it for new projects. Nov 06 10:37:49 devstack cinder-volume[85976]: If you are already using Eventlet, we recommend migrating to a different Nov 06 10:37:49 devstack cinder-volume[85976]: framework. For more detail see Nov 06 10:37:49 devstack cinder-volume[85976]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 10:37:49 devstack cinder-volume[85976]: import eventlet # noqa Nov 06 10:37:51 devstack cinder-volume[85976]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85976) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 10:37:51 devstack cinder-volume[85976]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85976) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 10:37:51 devstack cinder-volume[85976]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85976) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 10:37:52 devstack cinder-volume[85976]: INFO dbcounter [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Registered counter for database cinder Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85976) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG dbcounter [-] [85976] Writer thread running {{(pid=85976) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 10:37:52 devstack cinder-volume[85976]: INFO cinder.rpc [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 10:37:52 devstack cinder-volume[85976]: INFO cinder.rpc [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85976) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 10:37:52 devstack cinder-volume[85976]: INFO cinder.volume.manager [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Determined volume DB was empty at startup. Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG cinder.volume.manager [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85976) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 10:37:52 devstack cinder-volume[85976]: INFO cinder.volume.manager [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 10:37:52 devstack cinder-volume[85976]: WARNING stevedore.named [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 10:37:52 devstack cinder-volume[85976]: WARNING castellan.key_manager [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 10:37:52 devstack cinder-volume[85976]: WARNING cinder.keymgr.conf_key_mgr [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 10:37:52 devstack cinder-volume[85976]: INFO cinder.volume.manager [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85976) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 10:37:52 devstack cinder-volume[85976]: INFO oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Starting 1 workers Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Started child 86195 {{(pid=85976) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Full set of CONF: {{(pid=85976) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] ******************************************************************************** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Configuration options gathered from: {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] ================================================================================ {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] allow_availability_zone_fallback = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] allow_compression_on_image_upload = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] allowed_direct_url_schemes = [] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] api_rate_limit = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] auth_strategy = keystone {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_availability_zone = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_host = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[86195]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_name = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_stats_polling_interval = 60 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backup_api_class = cinder.backup.api.API {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backup_name_template = backup-%s {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backup_use_same_host = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backup_use_temp_snapshot = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] chap_password = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] chap_username = {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cinder_internal_tenant_project_id = 4356d1caa57848de865f6be412ba413f {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cinder_internal_tenant_user_id = c5cb000509d74019a17b91c97299284a {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cluster = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] compression_format = gzip {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] compute_api_class = cinder.compute.nova.API {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] config_dir = [] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] config_source = [] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] control_exchange = openstack {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] debug = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] default_availability_zone = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] default_group_type = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] default_volume_type = QuobyteHD {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] disk_geometry = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] driver_client_cert = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] driver_client_cert_key = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] driver_data_namespace = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] driver_ssl_cert_path = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] driver_ssl_cert_verify = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] driver_use_ssl = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] enable_new_services = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] enable_unsupported_driver = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] enabled_backends = ['QuobyteHD'] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] enforce_multipath_for_image_xfer = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] filter_function = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance_api_insecure = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance_api_servers = ['http://192.168.122.176/image'] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance_api_ssl_compression = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance_ca_certificates_file = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance_catalog_info = image:glance:publicURL {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance_certfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance_keyfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance_num_retries = 3 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance_request_timeout = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] goodness_function = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] graceful_shutdown_timeout = 5 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] group_api_class = cinder.group.api.API {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] host = devstack {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] image_compress_on_upload = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] image_conversion_address_space_limit = 1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] image_conversion_cpu_limit = 60 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] image_conversion_disable = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] image_introspection_address_space_limit = 1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] image_introspection_cpu_limit = 60 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] image_upload_use_cinder_backend = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] image_upload_use_internal_tenant = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] image_volume_cache_enabled = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] image_volume_cache_max_count = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] image_volume_cache_max_size_gb = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] init_host_max_objects_retrieval = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] instance_format = [instance: %(uuid)s] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] iscsi_target_flags = {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] iscsi_write_cache = on {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] iser_helper = tgtadm {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] iser_ip_address = 192.168.122.176 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] iser_port = 3260 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] log_color = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] log_config_append = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] log_dir = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] log_file = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] log_options = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[86195]: INFO cinder.volume.manager [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 10:37:52 devstack cinder-volume[86195]: DEBUG cinder.volume.drivers.remotefs [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86195) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] log_rotate_interval = 1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] log_rotate_interval_type = days {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] log_rotation_type = none {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] max_age = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] max_logfile_count = 30 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] max_logfile_size_mb = 200 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] max_over_subscription_ratio = 20.0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] message_reap_interval = 86400 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] message_ttl = 2592000 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] migration_create_volume_timeout_secs = 300 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] monkey_patch = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] monkey_patch_modules = [] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] my_ip = 192.168.122.176 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] no_snapshot_gb_quota = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] num_iser_scan_tries = 3 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] num_shell_tries = 3 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] num_volume_device_scan_tries = 3 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] nvmeof_conn_info_version = 1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] nvmet_ns_id = 10 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] nvmet_port_id = 1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] osapi_max_limit = 1000 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] osapi_volume_ext_list = [] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] osapi_volume_listen_port = 8776 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] osapi_volume_use_ssl = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] osapi_volume_workers = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] per_volume_size_limit = -1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] periodic_fuzzy_delay = 60 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] periodic_interval = 60 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] public_endpoint = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] publish_errors = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] quota_backup_gigabytes = 1000 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] quota_backups = 10 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] quota_gigabytes = 1000 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] quota_groups = 10 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] quota_snapshots = 10 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] quota_volumes = 10 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] rate_limit_burst = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] rate_limit_except_level = CRITICAL {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] rate_limit_interval = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] reinit_driver_count = 3 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] replication_device = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] report_discard_supported = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] report_interval = 120 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] reservation_clean_interval = 86400 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] reservation_expire = 86400 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] reserved_image_namespaces = [] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] reserved_percentage = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] rpc_response_timeout = 120 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] run_external_periodic_tasks = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] scst_target_driver = iscsi {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] scst_target_iqn_name = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] service_down_time = 720 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] shell_completion = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] snapshot_name_template = snapshot-%s {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] split_loggers = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] state_path = /opt/stack/data/cinder {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] storage_availability_zone = nova {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] storage_protocol = iSCSI {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] syslog_log_facility = LOG_USER {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] target_helper = lioadm {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] target_ip_address = 192.168.122.176 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] target_port = 3260 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] target_protocol = iscsi {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] target_secondary_ip_addresses = [] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] trace_flags = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] transport_url = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] until_refresh = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] use_chap_auth = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] use_default_quota_class = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] use_journal = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] use_json = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] use_multipath_for_image_xfer = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] use_stderr = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] use_syslog = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] verify_glance_signatures = enabled {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] volume_api_class = cinder.volume.api.API {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] volume_backend_name = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] volume_clear = zero {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] volume_clear_ionice = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] volume_clear_size = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] volume_copy_bps_limit = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] volume_dd_blocksize = 1M {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] volume_name_template = volume-%s {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] volume_service_inithost_offload = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] volume_usage_audit_period = month {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] zoning_mode = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_concurrency.disable_process_locking = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.auth_section = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.auth_type = password {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.auth_version = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.cache = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.certfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.include_service_catalog = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.insecure = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.interface = public {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.keyfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_password = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcache_username = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.region_name = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.service_type = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.176/identity {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[86195]: DEBUG cinder.volume.drivers.quobyte [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86195) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 10:37:52 devstack cinder-volume[86195]: WARNING cinder.volume.drivers.quobyte [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 10:37:52 devstack cinder-volume[86195]: WARNING cinder.volume.drivers.quobyte [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 10:37:52 devstack cinder-volume[86195]: DEBUG oslo_concurrency.processutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Running cmd (subprocess): mount.quobyte {{(pid=86195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.backend = dogpile.cache.null {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.backend_argument = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.backend_expiration_time = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.config_prefix = cache.oslo {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.debug_cache_backend = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.enable_retry_client = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.enable_socket_keepalive = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.enabled = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.expiration_time = 600 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.hashclient_retry_attempts = 2 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.memcache_dead_retry = 300 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.memcache_pool_maxsize = 10 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.memcache_sasl_enabled = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.password = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.proxies = [] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.redis_db = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.redis_server = localhost:6379 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.retry_attempts = 2 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.retry_delay = 0.0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.socket_keepalive_count = 1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.socket_keepalive_idle = 1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.socket_keepalive_interval = 1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.socket_timeout = 1.0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.tls_allowed_ciphers = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.tls_cafile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.tls_certfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.tls_enabled = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.tls_keyfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cache.username = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] coordination.backend_url = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:52 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.asyncio_connection = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.asyncio_slave_connection = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.backend = sqlalchemy {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.connection = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.connection_debug = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.connection_parameters = {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.connection_recycle_time = 3600 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.connection_trace = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.db_inc_retry_interval = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.db_max_retries = 20 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.db_max_retry_interval = 10 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.db_retry_interval = 1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.max_overflow = 50 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.max_pool_size = 5 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.max_retries = 10 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.mysql_wsrep_sync_wait = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.pool_timeout = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.retry_interval = 10 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.slave_connection = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.sqlite_synchronous = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.synchronous_reader = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] database.use_db_reconnect = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_tracing.insecure = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] profiler.connection_string = messaging:// {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] profiler.enabled = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] profiler.es_doc_type = notification {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] profiler.es_scroll_size = 10000 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] profiler.es_scroll_time = 2m {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] profiler.filter_error_trace = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] profiler.hmac_keys = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] profiler.sentinel_service_name = mymaster {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] profiler.socket_timeout = 0.1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] profiler.trace_requests = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] profiler.trace_sqlalchemy = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] profiler_jaeger.process_tags = {} {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] profiler_jaeger.service_name_prefix = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] profiler_otlp.service_name_prefix = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_policy.enforce_new_defaults = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_policy.policy_default_rule = default {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_policy.policy_file = policy.yaml {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] privsep_osbrick.group = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] privsep_osbrick.helper_command = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] privsep_osbrick.user = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cinder_sys_admin.group = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cinder_sys_admin.helper_command = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] cinder_sys_admin.user = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] service_user.auth_section = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] service_user.auth_type = password {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] service_user.cafile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] service_user.certfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] service_user.collect_timing = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] service_user.insecure = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] service_user.keyfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] service_user.send_service_user_token = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] service_user.split_loggers = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] service_user.timeout = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] service_user.tls_ciphers = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] service_user.tls_min_version = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance.auth_section = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance.auth_type = password {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance.certfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance.collect_timing = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance.insecure = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance.keyfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance.region_name = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance.split_loggers = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance.timeout = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance.tls_ciphers = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] glance.tls_min_version = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.backend_availability_zone = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.chap_password = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.chap_username = {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.disk_geometry = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.driver_client_cert = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.driver_client_cert_key = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.driver_data_namespace = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.driver_use_ssl = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.extra_capabilities = {} {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.filter_function = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.goodness_function = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.iscsi_target_flags = {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.iscsi_write_cache = on {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.iser_helper = tgtadm {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.iser_ip_address = 192.168.122.176 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.iser_port = 3260 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.nas_host = {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.nas_login = admin {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.nas_mount_options = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.nas_password = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.nas_private_key = {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.nas_share_path = {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.num_shell_tries = 3 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.quobyte_volume_url = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.replication_device = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.report_discard_supported = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.reserved_percentage = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.target_helper = tgtadm {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.target_ip_address = 192.168.122.176 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.target_port = 3260 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.target_protocol = iscsi {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.trace_flags = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.unique_fqdn_network = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.use_chap_auth = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.volume_backend_name = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.volume_clear = zero {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.volume_clear_ionice = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.volume_clear_size = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_reports.file_event_handler = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_reports.log_dir = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.backend_availability_zone = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.backend_host = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.chap_password = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.chap_username = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.chiscsi_conf = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.disk_geometry = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.driver_client_cert = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.driver_data_namespace = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.driver_use_ssl = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.extra_capabilities = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.filter_function = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.goodness_function = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.iser_helper = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.iser_ip_address = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.iser_port = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.iser_target_prefix = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.nas_host = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.nas_login = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.nas_mount_options = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.nas_password = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.nas_private_key = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.nas_share_path = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.nas_ssh_port = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.num_shell_tries = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.nvmet_port_id = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.replication_device = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.report_discard_supported = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.reserved_percentage = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.scst_target_driver = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.storage_protocol = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.target_helper = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.target_ip_address = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.target_port = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.target_prefix = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.target_protocol = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.trace_flags = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.use_chap_auth = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.volume_clear = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.volume_clear_size = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] QuobyteHD.volumes_dir = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.ssl = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_notifications.driver = [] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_notifications.retry = -1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] key_manager.fixed_key = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.barbican_api_version = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.barbican_endpoint = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.barbican_endpoint_type = public {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.barbican_region_name = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.cafile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.certfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.collect_timing = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.insecure = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.keyfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.number_of_retries = 60 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.retry_delay = 1 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack quobyte-client[86196]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 10:37:53 devstack quobyte-client[86196]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.send_service_user_token = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.split_loggers = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.timeout = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.tls_ciphers = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.tls_min_version = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.verify_ssl = True {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican.verify_ssl_path = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican_service_user.auth_section = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican_service_user.auth_type = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican_service_user.cafile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG oslo_concurrency.processutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] CMD "mount.quobyte" returned: 1 in 0.191s {{(pid=86195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG cinder.volume.drivers.quobyte [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:37:53 devstack cinder-volume[86195]: INFO cinder.volume.drivers.quobyte [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 ... Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican_service_user.certfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican_service_user.collect_timing = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican_service_user.insecure = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican_service_user.keyfile = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican_service_user.split_loggers = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican_service_user.timeout = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican_service_user.tls_ciphers = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] barbican_service_user.tls_min_version = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG oslo_concurrency.processutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 -c /etc/quobyte/client-cinder.cfg {{(pid=86195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vault.approle_role_id = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vault.approle_secret_id = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vault.auth_method = approle {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vault.auth_path = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vault.kv_mountpoint = secret {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vault.kv_path = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vault.kv_version = 2 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vault.namespace = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vault.root_token_id = **** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vault.ssl_ca_crt_file = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vault.timeout = 60.0 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vault.token_file = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vault.token_role = None {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vault.use_ssl = False {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:37:53 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] ******************************************************************************** {{(pid=85976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 10:37:53 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 -c /etc/quobyte/client-cinder.cfg Nov 06 10:37:53 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:37:53 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG oslo_concurrency.processutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.417s {{(pid=86195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:37:53 devstack cinder-volume[86195]: INFO cinder.volume.drivers.quobyte [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 succeeded Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG cinder.volume.drivers.quobyte [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.432s {{(pid=86195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG oslo_concurrency.processutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:37:53 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:37:53 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:37:53 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG oslo_concurrency.processutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.244s {{(pid=86195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:37:53 devstack cinder-volume[86195]: INFO cinder.volume.driver [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG cinder.volume.driver [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3973922729492, 'free_capacity_gb': 1773.3973922729492, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86195) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG oslo_db.sqlalchemy.engines [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86195) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG dbcounter [-] [86195] Writer thread running {{(pid=86195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG cinder.db.api [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Building query based on filter {{(pid=86195) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3918}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG cinder.image.image_utils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86195) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 10:37:53 devstack cinder-volume[86195]: INFO cinder.keymgr.migration [None req-934c5a6d-a0d0-403b-b954-556c70bcf46e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG cinder.volume.drivers.quobyte [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG cinder.volume.drivers.quobyte [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:37:53 devstack cinder-volume[86195]: DEBUG oslo_concurrency.processutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:37:54 devstack sudo[86307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:37:54 devstack sudo[86307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:37:54 devstack sudo[86307]: pam_unix(sudo:session): session closed for user root Nov 06 10:37:54 devstack cinder-volume[86195]: DEBUG oslo_concurrency.processutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.237s {{(pid=86195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:37:54 devstack cinder-volume[86195]: DEBUG cinder.manager [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Notifying Schedulers of capabilities ... {{(pid=86195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:37:54 devstack cinder-volume[86195]: INFO cinder.volume.manager [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Driver initialization completed successfully. Nov 06 10:37:54 devstack cinder-volume[86195]: INFO cinder.manager [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Initiating service 3 cleanup Nov 06 10:37:54 devstack cinder-volume[86195]: INFO cinder.manager [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Service 3 cleanup completed. Nov 06 10:37:54 devstack cinder-volume[86195]: DEBUG cinder.service [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Creating RPC server for service cinder-volume {{(pid=86195) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 10:37:54 devstack cinder-volume[86195]: DEBUG cinder.service [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86195) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 10:37:54 devstack cinder-volume[86195]: INFO cinder.volume.manager [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 10:37:54 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:37:54 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:37:54 devstack cinder-volume[86195]: DEBUG cinder.volume.drivers.quobyte [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:37:54 devstack cinder-volume[86195]: DEBUG cinder.volume.drivers.quobyte [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:37:54 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:37:54 devstack cinder-volume[86195]: DEBUG oslo_concurrency.processutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:37:54 devstack sudo[86311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:37:54 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:37:54 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root Nov 06 10:37:54 devstack cinder-volume[86195]: DEBUG oslo_concurrency.processutils [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.249s {{(pid=86195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:37:54 devstack cinder-volume[86195]: INFO cinder.volume.manager [None req-09de3b08-1e19-4736-adeb-c3b43b839464 None None] Driver post RPC initialization completed successfully. Nov 06 10:37:59 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-43b94529-f041-409d-89a3-0fb51913473b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:37:59 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-43b94529-f041-409d-89a3-0fb51913473b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:37:59 devstack cinder-volume[86195]: DEBUG cinder.volume.drivers.quobyte [None req-43b94529-f041-409d-89a3-0fb51913473b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:37:59 devstack cinder-volume[86195]: DEBUG cinder.volume.drivers.quobyte [None req-43b94529-f041-409d-89a3-0fb51913473b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:37:59 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-43b94529-f041-409d-89a3-0fb51913473b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:37:59 devstack cinder-volume[86195]: DEBUG oslo_concurrency.processutils [None req-43b94529-f041-409d-89a3-0fb51913473b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:37:59 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:37:59 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:37:59 devstack cinder-volume[85976]: INFO oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Caught SIGTERM, stopping children Nov 06 10:37:59 devstack cinder-volume[85976]: DEBUG oslo_concurrency.lockutils [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Acquiring lock "singleton_lock" {{(pid=85976) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 10:37:59 devstack cinder-volume[85976]: DEBUG oslo_concurrency.lockutils [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Acquired lock "singleton_lock" {{(pid=85976) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 10:37:59 devstack cinder-volume[85976]: DEBUG oslo_concurrency.lockutils [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Releasing lock "singleton_lock" {{(pid=85976) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 10:37:59 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Stop services. {{(pid=85976) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 10:37:59 devstack cinder-volume[85976]: DEBUG oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Killing children. {{(pid=85976) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 10:37:59 devstack cinder-volume[85976]: INFO oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Waiting on 1 children to exit Nov 06 10:37:59 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Nov 06 10:37:59 devstack cinder-volume[86195]: DEBUG oslo_concurrency.processutils [None req-43b94529-f041-409d-89a3-0fb51913473b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.301s {{(pid=86195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:37:59 devstack cinder-volume[86195]: DEBUG cinder.manager [None req-43b94529-f041-409d-89a3-0fb51913473b None None] Notifying Schedulers of capabilities ... {{(pid=86195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo.messaging._drivers.impl_rabbit [None req-43b94529-f041-409d-89a3-0fb51913473b None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo.messaging._drivers.impl_rabbit [None req-43b94529-f041-409d-89a3-0fb51913473b None None] Unable to connect to AMQP server on 192.168.122.176:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server [None req-43b94529-f041-409d-89a3-0fb51913473b None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.176:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server method() Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _publish Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server self._producer.publish( Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server return _publish( Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server listener(*args) Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server raise error_for_code( Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server self.transport._send( Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 824, in send Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 799, in _send Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1694, in fanout_send Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1524, in _ensure_publishing Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1135, in ensure Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.176:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 06 10:37:59 devstack cinder-volume[86195]: ERROR oslo_messaging.rpc.server Nov 06 10:38:02 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Acquiring lock "singleton_lock" {{(pid=86195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 10:38:02 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Acquired lock "singleton_lock" {{(pid=86195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 10:38:02 devstack cinder-volume[86195]: DEBUG oslo_concurrency.lockutils [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Releasing lock "singleton_lock" {{(pid=86195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 10:38:02 devstack cinder-volume[86195]: WARNING amqp [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 10:38:02 devstack cinder-volume[86195]: WARNING amqp [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 10:38:02 devstack cinder-volume[85976]: INFO oslo_service.backend._eventlet.service [None req-2a6da543-44f1-42be-9d10-1d263a0adb21 None None] Child 86195 exited with status 0 Nov 06 10:38:03 devstack cinder-volume[86514]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 10:38:03 devstack cinder-volume[86514]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 10:38:03 devstack cinder-volume[86514]: we strongly recommend against using it for new projects. Nov 06 10:38:03 devstack cinder-volume[86514]: If you are already using Eventlet, we recommend migrating to a different Nov 06 10:38:03 devstack cinder-volume[86514]: framework. For more detail see Nov 06 10:38:03 devstack cinder-volume[86514]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 10:38:03 devstack cinder-volume[86514]: import eventlet # noqa Nov 06 10:38:06 devstack cinder-volume[86514]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86514) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 10:38:06 devstack cinder-volume[86514]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86514) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 10:38:06 devstack cinder-volume[86514]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86514) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 10:38:07 devstack cinder-volume[86514]: INFO dbcounter [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] Registered counter for database cinder Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_db.sqlalchemy.engines [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86514) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG dbcounter [-] [86514] Writer thread running {{(pid=86514) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 10:38:07 devstack cinder-volume[86514]: INFO cinder.rpc [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 10:38:07 devstack cinder-volume[86514]: INFO cinder.rpc [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_db.sqlalchemy.engines [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86514) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 10:38:07 devstack cinder-volume[86514]: INFO cinder.volume.manager [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] Determined volume DB was empty at startup. Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG cinder.volume.manager [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86514) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 10:38:07 devstack cinder-volume[86514]: WARNING stevedore.named [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 10:38:07 devstack cinder-volume[86514]: WARNING castellan.key_manager [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 10:38:07 devstack cinder-volume[86514]: WARNING cinder.keymgr.conf_key_mgr [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 10:38:07 devstack cinder-volume[86514]: INFO cinder.volume.manager [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_db.sqlalchemy.engines [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86514) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 10:38:07 devstack cinder-volume[86514]: INFO oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] Starting 1 workers Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] Started child 86819 {{(pid=86514) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] Full set of CONF: {{(pid=86514) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] ******************************************************************************** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] Configuration options gathered from: {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] ================================================================================ {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] allow_availability_zone_fallback = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] allow_compression_on_image_upload = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] allowed_direct_url_schemes = [] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] api_rate_limit = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] auth_strategy = keystone {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_availability_zone = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_host = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_name = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_stats_polling_interval = 60 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backup_api_class = cinder.backup.api.API {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backup_name_template = backup-%s {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backup_use_same_host = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backup_use_temp_snapshot = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] chap_password = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] chap_username = {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cinder_internal_tenant_project_id = 4356d1caa57848de865f6be412ba413f {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cinder_internal_tenant_user_id = c5cb000509d74019a17b91c97299284a {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cluster = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] compression_format = gzip {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86819]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] compute_api_class = cinder.compute.nova.API {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] config_dir = [] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] config_source = [] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] control_exchange = openstack {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] debug = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] default_availability_zone = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] default_group_type = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] default_volume_type = QuobyteHD {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] disk_geometry = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] driver_client_cert = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] driver_client_cert_key = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] driver_data_namespace = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] driver_ssl_cert_path = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] driver_ssl_cert_verify = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] driver_use_ssl = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] enable_new_services = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] enable_unsupported_driver = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] enabled_backends = ['QuobyteHD'] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] enforce_multipath_for_image_xfer = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] filter_function = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance_api_insecure = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance_api_servers = ['http://192.168.122.176/image'] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance_api_ssl_compression = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance_ca_certificates_file = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance_catalog_info = image:glance:publicURL {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance_certfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance_keyfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance_num_retries = 3 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance_request_timeout = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] goodness_function = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] graceful_shutdown_timeout = 5 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] group_api_class = cinder.group.api.API {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] host = devstack {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] image_compress_on_upload = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] image_conversion_address_space_limit = 1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] image_conversion_cpu_limit = 60 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] image_conversion_disable = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] image_introspection_address_space_limit = 1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] image_introspection_cpu_limit = 60 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] image_upload_use_cinder_backend = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] image_upload_use_internal_tenant = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] image_volume_cache_enabled = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86819) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] image_volume_cache_max_count = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] image_volume_cache_max_size_gb = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] init_host_max_objects_retrieval = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] instance_format = [instance: %(uuid)s] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] iscsi_target_flags = {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] iscsi_write_cache = on {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] iser_helper = tgtadm {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] iser_ip_address = 192.168.122.176 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] iser_port = 3260 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] log_color = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] log_config_append = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] log_dir = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] log_file = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] log_options = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] log_rotate_interval = 1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] log_rotate_interval_type = days {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] log_rotation_type = none {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] max_age = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] max_logfile_count = 30 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] max_logfile_size_mb = 200 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] max_over_subscription_ratio = 20.0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] message_reap_interval = 86400 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] message_ttl = 2592000 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] migration_create_volume_timeout_secs = 300 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] monkey_patch = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] monkey_patch_modules = [] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] my_ip = 192.168.122.176 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] no_snapshot_gb_quota = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] num_iser_scan_tries = 3 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] num_shell_tries = 3 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] num_volume_device_scan_tries = 3 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] nvmeof_conn_info_version = 1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] nvmet_ns_id = 10 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] nvmet_port_id = 1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] osapi_max_limit = 1000 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] osapi_volume_ext_list = [] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] osapi_volume_listen = 0.0.0.0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] osapi_volume_listen_port = 8776 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] osapi_volume_use_ssl = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] osapi_volume_workers = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] per_volume_size_limit = -1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] periodic_fuzzy_delay = 60 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] periodic_interval = 60 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] project_id_regex = [0-9a-f\-]+ {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] public_endpoint = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] publish_errors = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] quota_backup_gigabytes = 1000 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] quota_backups = 10 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] quota_gigabytes = 1000 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] quota_groups = 10 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] quota_snapshots = 10 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] quota_volumes = 10 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] rate_limit_burst = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] rate_limit_except_level = CRITICAL {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] rate_limit_interval = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] reinit_driver_count = 3 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] replication_device = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] report_discard_supported = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] report_interval = 120 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86819) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 10:38:07 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.quobyte [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 10:38:07 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.quobyte [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] reservation_clean_interval = 86400 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] reservation_expire = 86400 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] reserved_image_namespaces = [] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] reserved_percentage = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Running cmd (subprocess): mount.quobyte {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] rpc_response_timeout = 120 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] run_external_periodic_tasks = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] scst_target_driver = iscsi {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] scst_target_iqn_name = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] service_down_time = 720 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] shell_completion = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] snapshot_name_template = snapshot-%s {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] split_loggers = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] state_path = /opt/stack/data/cinder {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] storage_availability_zone = nova {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] storage_protocol = iSCSI {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] syslog_log_facility = LOG_USER {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] target_helper = lioadm {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] target_ip_address = 192.168.122.176 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] target_port = 3260 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] target_protocol = iscsi {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] target_secondary_ip_addresses = [] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] trace_flags = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] transfer_api_class = cinder.transfer.api.API {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] transport_url = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] until_refresh = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] use_chap_auth = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] use_default_quota_class = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] use_journal = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] use_json = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] use_multipath_for_image_xfer = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] use_stderr = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] use_syslog = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] verify_glance_signatures = enabled {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] volume_api_class = cinder.volume.api.API {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] volume_backend_name = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] volume_clear = zero {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] volume_clear_ionice = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] volume_clear_size = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] volume_copy_bps_limit = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] volume_dd_blocksize = 1M {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] volume_name_template = volume-%s {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] volume_service_inithost_offload = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] volume_usage_audit_period = month {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] zoning_mode = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_concurrency.disable_process_locking = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.auth_section = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.auth_type = password {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.auth_version = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.cache = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.certfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.delay_auth_decision = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.http_connect_timeout = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.include_service_catalog = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.insecure = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.interface = public {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.keyfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_password = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcache_username = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.region_name = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.service_token_roles_required = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.service_type = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.token_cache_time = 300 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.176/identity {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.backend = dogpile.cache.null {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.backend_argument = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.backend_expiration_time = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.config_prefix = cache.oslo {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.debug_cache_backend = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.enable_retry_client = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.enable_socket_keepalive = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.enabled = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.expiration_time = 600 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack quobyte-client[86820]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 10:38:07 devstack quobyte-client[86820]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.hashclient_retry_attempts = 2 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.memcache_dead_retry = 300 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.memcache_pool_maxsize = 10 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.memcache_sasl_enabled = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.password = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.proxies = [] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.redis_db = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.redis_sentinel_service_name = mymaster {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.redis_server = localhost:6379 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.retry_attempts = 2 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.retry_delay = 0.0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.socket_keepalive_count = 1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.socket_keepalive_idle = 1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.socket_keepalive_interval = 1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.socket_timeout = 1.0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.tls_allowed_ciphers = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.tls_cafile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.tls_certfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.tls_enabled = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.tls_keyfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cache.username = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] coordination.backend_url = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.asyncio_connection = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.asyncio_slave_connection = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.backend = sqlalchemy {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.connection = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.connection_debug = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.connection_parameters = {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:38:07 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.connection_recycle_time = 3600 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.connection_trace = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.db_inc_retry_interval = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.db_max_retries = 20 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.db_max_retry_interval = 10 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.db_retry_interval = 1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.max_overflow = 50 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.max_pool_size = 5 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.max_retries = 10 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.mysql_wsrep_sync_wait = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.pool_timeout = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.retry_interval = 10 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.slave_connection = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.sqlite_synchronous = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.synchronous_reader = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] database.use_db_reconnect = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_tracing.insecure = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] profiler.connection_string = messaging:// {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] profiler.enabled = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] profiler.es_doc_type = notification {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] profiler.es_scroll_size = 10000 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] profiler.es_scroll_time = 2m {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] profiler.filter_error_trace = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] profiler.hmac_keys = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] profiler.sentinel_service_name = mymaster {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] profiler.socket_timeout = 0.1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] profiler.trace_requests = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] profiler.trace_sqlalchemy = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] profiler_jaeger.process_tags = {} {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] profiler_jaeger.service_name_prefix = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] profiler_otlp.service_name_prefix = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_policy.enforce_new_defaults = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_policy.policy_default_rule = default {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_policy.policy_file = policy.yaml {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_policy.remote_timeout = 60.0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] privsep_osbrick.group = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] privsep_osbrick.helper_command = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] privsep_osbrick.user = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cinder_sys_admin.group = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cinder_sys_admin.helper_command = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] cinder_sys_admin.user = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] service_user.auth_section = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] service_user.auth_type = password {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] service_user.cafile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] service_user.certfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] service_user.collect_timing = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] service_user.insecure = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] service_user.keyfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] service_user.send_service_user_token = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] service_user.split_loggers = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] service_user.timeout = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] service_user.tls_ciphers = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] service_user.tls_min_version = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance.auth_section = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance.auth_type = password {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance.certfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance.collect_timing = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance.insecure = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance.keyfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance.region_name = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance.split_loggers = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance.timeout = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance.tls_ciphers = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] glance.tls_min_version = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.backend_availability_zone = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.chap_password = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.chap_username = {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.disk_geometry = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.driver_client_cert = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.driver_client_cert_key = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.driver_data_namespace = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.driver_use_ssl = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.enable_unsupported_driver = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.extra_capabilities = {} {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.filter_function = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.goodness_function = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack sudo[86829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.iscsi_target_flags = {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.iscsi_write_cache = on {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.iser_helper = tgtadm {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.iser_ip_address = 192.168.122.176 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.iser_port = 3260 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.nas_host = {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.nas_login = admin {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.nas_mount_options = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.nas_password = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.nas_private_key = {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.nas_share_path = {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.nas_ssh_port = 22 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.num_shell_tries = 3 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.nvmet_port_id = 1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.quobyte_client_cfg = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.quobyte_volume_url = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.replication_device = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.report_discard_supported = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.reserved_percentage = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.scst_target_driver = iscsi {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.scst_target_iqn_name = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.storage_protocol = iSCSI {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.target_helper = tgtadm {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.target_ip_address = 192.168.122.176 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.target_port = 3260 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.target_protocol = iscsi {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.trace_flags = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.unique_fqdn_network = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.use_chap_auth = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.volume_backend_name = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.volume_clear = zero {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.volume_clear_ionice = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.volume_clear_size = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_reports.file_event_handler = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_reports.log_dir = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.backend_availability_zone = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.backend_host = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.chap_password = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.chap_username = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.chiscsi_conf = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.disk_geometry = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.driver_client_cert = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.driver_client_cert_key = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.driver_data_namespace = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.driver_use_ssl = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.extra_capabilities = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.filter_function = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.goodness_function = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.iscsi_target_flags = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.iscsi_write_cache = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.iser_helper = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.iser_ip_address = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.iser_port = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.iser_target_prefix = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.nas_host = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.nas_login = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.nas_mount_options = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.nas_password = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.nas_private_key = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.nas_share_path = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.nas_ssh_port = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.num_shell_tries = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.nvmet_ns_id = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.nvmet_port_id = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.replication_device = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.report_discard_supported = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.reserved_percentage = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.scst_target_driver = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.storage_protocol = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.target_helper = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.target_ip_address = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.target_port = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.target_prefix = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.target_protocol = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.trace_flags = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.unique_fqdn_network = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.use_chap_auth = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.volume_clear = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.volume_clear_ionice = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.volume_clear_size = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] QuobyteHD.volumes_dir = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.ssl = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.ssl_version = {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_notifications.driver = [] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_notifications.retry = -1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] oslo_messaging_notifications.transport_url = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] key_manager.fixed_key = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.barbican_api_version = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.barbican_endpoint = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.barbican_endpoint_type = public {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.barbican_region_name = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.cafile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.certfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.collect_timing = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.insecure = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.keyfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.number_of_retries = 60 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.retry_delay = 1 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.send_service_user_token = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.split_loggers = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.timeout = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.tls_ciphers = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.tls_min_version = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.verify_ssl = True {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican.verify_ssl_path = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican_service_user.auth_section = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican_service_user.auth_type = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican_service_user.cafile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican_service_user.certfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican_service_user.collect_timing = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican_service_user.insecure = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican_service_user.keyfile = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican_service_user.split_loggers = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican_service_user.timeout = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican_service_user.tls_ciphers = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] barbican_service_user.tls_min_version = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vault.approle_role_id = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vault.approle_secret_id = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vault.auth_method = approle {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vault.auth_path = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vault.kv_mountpoint = secret {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vault.kv_path = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vault.kv_version = 2 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vault.namespace = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vault.root_token_id = **** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vault.ssl_ca_crt_file = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vault.timeout = 60.0 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vault.token_file = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vault.token_role = None {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vault.use_ssl = False {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 10:38:08 devstack cinder-volume[86514]: DEBUG oslo_service.backend._eventlet.service [None req-6f1b9d97-2fab-4c80-bb49-77f4f0a89bcb None None] ******************************************************************************** {{(pid=86514) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 10:38:08 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.286s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:38:08 devstack cinder-volume[86819]: INFO cinder.volume.driver [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Driver hasn't implemented _init_vendor_properties() Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG cinder.volume.driver [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3973922729492, 'free_capacity_gb': 1773.3973922729492, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86819) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG oslo_db.sqlalchemy.engines [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86819) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writer thread running {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG cinder.db.api [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Building query based on filter {{(pid=86819) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3918}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86819) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:38:08 devstack cinder-volume[86819]: INFO cinder.keymgr.migration [None req-2ab84985-557e-461b-835b-67b01b47c3a9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 10:38:08 devstack sudo[86840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:38:08 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:38:08 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.257s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:38:08 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Driver initialization completed successfully. Nov 06 10:38:08 devstack cinder-volume[86819]: INFO cinder.manager [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Initiating service 3 cleanup Nov 06 10:38:08 devstack cinder-volume[86819]: INFO cinder.manager [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Service 3 cleanup completed. Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG cinder.service [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Creating RPC server for service cinder-volume {{(pid=86819) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG cinder.service [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86819) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 10:38:08 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:38:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:38:08 devstack sudo[86853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:38:08 devstack sudo[86853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:38:09 devstack sudo[86853]: pam_unix(sudo:session): session closed for user root Nov 06 10:38:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.250s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:38:09 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-62fc5a09-1ceb-438b-8693-9270ec4b7d2b None None] Driver post RPC initialization completed successfully. Nov 06 10:38:17 devstack cinder-volume[86514]: DEBUG dbcounter [-] [86514] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86514) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:38:18 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=2 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:38:19 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:38:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:38:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 6 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:38:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Flow 'volume_create_manager' (3585c6f4-144f-48c0-aab4-7dde4b0ffcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21625c5f-cab4-4f92-a9e6-1bc6eb2a6537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21625c5f-cab4-4f92-a9e6-1bc6eb2a6537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2002551911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cadae32-b8cd-479d-a44b-1cb8f417a30f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31f46218b9246d0a29e19b7e976b102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:39:21Z,use_quota=True,user_id='dc3de68f34a04652a9f73ea2adb7e30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c112bd-dd8e-406e-a5dc-a9f7a7238c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c112bd-dd8e-406e-a5dc-a9f7a7238c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc79f03-39ad-4350-a180-ab9a48763bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc79f03-39ad-4350-a180-ab9a48763bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cadae32-b8cd-479d-a44b-1cb8f417a30f', 'volume_name': 'volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24d00db-03ad-459a-98c0-1d6eed336cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24d00db-03ad-459a-98c0-1d6eed336cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22072525-cdda-4ac4-b11a-e3abcd989427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:21 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Volume 5cadae32-b8cd-479d-a44b-1cb8f417a30f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f', 'volume_size': 1} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2002551911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cadae32-b8cd-479d-a44b-1cb8f417a30f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31f46218b9246d0a29e19b7e976b102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:39:21Z,use_quota=True,user_id='dc3de68f34a04652a9f73ea2adb7e30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Creating volume 5cadae32-b8cd-479d-a44b-1cb8f417a30f {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:39:21 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:39:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:39:21 devstack sudo[87586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f 1073741824 Nov 06 10:39:21 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:39:23 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root Nov 06 10:39:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f 1073741824" returned: 0 in 1.675s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:39:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:39:23 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f Nov 06 10:39:23 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:39:24 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Nov 06 10:39:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f" returned: 0 in 0.802s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:39:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] <== create_volume: return (2665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:39:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.678s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:39:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22072525-cdda-4ac4-b11a-e3abcd989427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49127c88-adb0-45bb-9b85-c3ad6369a060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:24 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Volume volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f (5cadae32-b8cd-479d-a44b-1cb8f417a30f): created successfully Nov 06 10:39:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49127c88-adb0-45bb-9b85-c3ad6369a060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Flow 'volume_create_manager' (3585c6f4-144f-48c0-aab4-7dde4b0ffcd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:39:24 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-38647806-de80-477e-9661-ede0324f0989 tempest-DeleteServersTestJSON-965579767 None] Created volume successfully. Nov 06 10:39:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-bb1a0f05-be16-460c-9a27-cd7d804250b5 req-53a506a6-9b79-4716-89bd-058e609bd12d tempest-DeleteServersTestJSON-965579767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:39:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-bb1a0f05-be16-460c-9a27-cd7d804250b5 req-53a506a6-9b79-4716-89bd-058e609bd12d tempest-DeleteServersTestJSON-965579767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:39:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-bb1a0f05-be16-460c-9a27-cd7d804250b5 req-53a506a6-9b79-4716-89bd-058e609bd12d tempest-DeleteServersTestJSON-965579767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.085s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:39:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-bb1a0f05-be16-460c-9a27-cd7d804250b5 req-53a506a6-9b79-4716-89bd-058e609bd12d tempest-DeleteServersTestJSON-965579767 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a401c56b-5288-4e14-9b7c-2bad407c9c40', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:39:34 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-bb1a0f05-be16-460c-9a27-cd7d804250b5 req-53a506a6-9b79-4716-89bd-058e609bd12d tempest-DeleteServersTestJSON-965579767 None] attachment_update completed successfully. Nov 06 10:39:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:39:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:39:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:39:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:39:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:39:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:39:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:39:36 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:39:36 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:39:37 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Nov 06 10:39:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.920s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:39:37 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:39:37 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:39:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 6 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:39:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Flow 'volume_create_manager' (027da1e5-29e6-4026-99a3-d46614125285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139cc331-cb63-4d67-8f24-e17328e91fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139cc331-cb63-4d67-8f24-e17328e91fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-186027475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0cf2115-8787-4b05-acc4-08429e2792d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0feca785a74d40c7a97b268ede2184bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:39:41Z,use_quota=True,user_id='4a187f8f831e42babe87d369513aaded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c08b39-cfb7-4cfb-8310-35e44e12c60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c08b39-cfb7-4cfb-8310-35e44e12c60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6b9379-d092-4efe-aac8-9e19a15c7b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6b9379-d092-4efe-aac8-9e19a15c7b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0cf2115-8787-4b05-acc4-08429e2792d7', 'volume_name': 'volume-c0cf2115-8787-4b05-acc4-08429e2792d7', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b26af4-234c-4fd9-ae20-02fe92d31c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b26af4-234c-4fd9-ae20-02fe92d31c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca53c79f-c11b-4853-87fe-863f389a7921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:41 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Volume c0cf2115-8787-4b05-acc4-08429e2792d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0cf2115-8787-4b05-acc4-08429e2792d7', 'volume_size': 1} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-186027475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0cf2115-8787-4b05-acc4-08429e2792d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0feca785a74d40c7a97b268ede2184bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:39:41Z,use_quota=True,user_id='4a187f8f831e42babe87d369513aaded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Creating volume c0cf2115-8787-4b05-acc4-08429e2792d7 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:39:41 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:39:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c0cf2115-8787-4b05-acc4-08429e2792d7 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:39:41 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c0cf2115-8787-4b05-acc4-08429e2792d7 1073741824 Nov 06 10:39:41 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:39:42 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Nov 06 10:39:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c0cf2115-8787-4b05-acc4-08429e2792d7 1073741824" returned: 0 in 0.806s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:39:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c0cf2115-8787-4b05-acc4-08429e2792d7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:39:42 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c0cf2115-8787-4b05-acc4-08429e2792d7 Nov 06 10:39:42 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:39:42 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Nov 06 10:39:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c0cf2115-8787-4b05-acc4-08429e2792d7" returned: 0 in 0.484s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:39:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:39:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:39:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca53c79f-c11b-4853-87fe-863f389a7921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0cf2115-8787-4b05-acc4-08429e2792d7', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9979d014-4544-489b-99e0-6950befdf084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:42 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Volume volume-c0cf2115-8787-4b05-acc4-08429e2792d7 (c0cf2115-8787-4b05-acc4-08429e2792d7): created successfully Nov 06 10:39:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9979d014-4544-489b-99e0-6950befdf084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Flow 'volume_create_manager' (027da1e5-29e6-4026-99a3-d46614125285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:39:42 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ae7a6772-8ac2-4603-859a-1bb01ccfb183 tempest-VolumesAdminNegativeTest-1072347252 None] Created volume successfully. Nov 06 10:39:42 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-29352866-633f-4d53-a6de-1514ea94010a req-d06d8a51-c843-4044-b28d-b5377cc09259 tempest-DeleteServersTestJSON-965579767 None] Terminate volume connection completed successfully. Nov 06 10:39:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-29352866-633f-4d53-a6de-1514ea94010a req-d06d8a51-c843-4044-b28d-b5377cc09259 tempest-DeleteServersTestJSON-965579767 None] Deleting attachment a401c56b-5288-4e14-9b7c-2bad407c9c40. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:39:44 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:39:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Flow 'volume_create_manager' (e35c9809-2337-4534-a110-628b3789f123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:39:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9c6a08-9869-4f87-980b-a4a41ca06fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Acquiring lock "cinder-c0cf2115-8787-4b05-acc4-08429e2792d7-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:39:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9c6a08-9869-4f87-980b-a4a41ca06fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-384204731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8221a2cb-7dbb-4f31-af68-445f3b658240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe7a59242fb471cbe1f9deb8ca9baed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:39:44Z,use_quota=True,user_id='4f882b3bdecc4379b551d7142e3b484e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37113025-834e-4ab7-a44c-9caecc2d3907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37113025-834e-4ab7-a44c-9caecc2d3907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1b402b-6bb6-4151-801b-dd08139a3ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1b402b-6bb6-4151-801b-dd08139a3ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8221a2cb-7dbb-4f31-af68-445f3b658240', 'volume_name': 'volume-8221a2cb-7dbb-4f31-af68-445f3b658240', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10aebd3-99d3-4cdd-8d3f-9717f4ef3a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10aebd3-99d3-4cdd-8d3f-9717f4ef3a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5b48a3-f2f0-40d6-a781-33b5062f3671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:45 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Volume 8221a2cb-7dbb-4f31-af68-445f3b658240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8221a2cb-7dbb-4f31-af68-445f3b658240', 'volume_size': 1} Nov 06 10:39:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:39:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:39:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-384204731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8221a2cb-7dbb-4f31-af68-445f3b658240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe7a59242fb471cbe1f9deb8ca9baed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:39:44Z,use_quota=True,user_id='4f882b3bdecc4379b551d7142e3b484e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:39:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Creating volume 8221a2cb-7dbb-4f31-af68-445f3b658240 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:39:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:39:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:39:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:39:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:39:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:39:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:39:45 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:39:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8221a2cb-7dbb-4f31-af68-445f3b658240 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:39:45 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8221a2cb-7dbb-4f31-af68-445f3b658240 1073741824 Nov 06 10:39:45 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:39:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Lock "cinder-c0cf2115-8787-4b05-acc4-08429e2792d7-delete_volume" acquired by "delete_volume" :: waited 0.508s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:39:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Acquiring lock "cinder-quobyte-c0cf2115-8787-4b05-acc4-08429e2792d7" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:39:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Lock "cinder-quobyte-c0cf2115-8787-4b05-acc4-08429e2792d7" acquired by "delete_volume" :: waited 0.039s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:39:45 devstack cinder-volume[86819]: INFO oslo.privsep.daemon [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9la4a5mx/privsep.sock'] Nov 06 10:39:45 devstack sudo[88653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9la4a5mx/privsep.sock Nov 06 10:39:45 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:39:46 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Nov 06 10:39:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8221a2cb-7dbb-4f31-af68-445f3b658240 1073741824" returned: 0 in 1.167s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:39:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8221a2cb-7dbb-4f31-af68-445f3b658240 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:39:46 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8221a2cb-7dbb-4f31-af68-445f3b658240 Nov 06 10:39:46 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:39:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Acquiring lock "cinder-5cadae32-b8cd-479d-a44b-1cb8f417a30f-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:39:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Lock "cinder-5cadae32-b8cd-479d-a44b-1cb8f417a30f-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:39:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Acquiring lock "cinder-quobyte-5cadae32-b8cd-479d-a44b-1cb8f417a30f" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:39:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Lock "cinder-quobyte-5cadae32-b8cd-479d-a44b-1cb8f417a30f" acquired by "delete_volume" :: waited 0.047s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:39:47 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Nov 06 10:39:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8221a2cb-7dbb-4f31-af68-445f3b658240" returned: 0 in 0.846s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:39:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] <== create_volume: return (2133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:39:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:39:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5b48a3-f2f0-40d6-a781-33b5062f3671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8221a2cb-7dbb-4f31-af68-445f3b658240', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a629b2-9166-4fda-a232-c67fe91ef6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:39:47 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Volume volume-8221a2cb-7dbb-4f31-af68-445f3b658240 (8221a2cb-7dbb-4f31-af68-445f3b658240): created successfully Nov 06 10:39:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a629b2-9166-4fda-a232-c67fe91ef6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:39:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Flow 'volume_create_manager' (e35c9809-2337-4534-a110-628b3789f123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:39:47 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-324eaa8b-f480-47ed-aed9-8a4464f81b0a tempest-ServerRescueNegativeTestJSON-1382760736 None] Created volume successfully. Nov 06 10:39:47 devstack cinder-volume[86819]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 06 10:39:47 devstack cinder-volume[86819]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 10:39:47 devstack cinder-volume[86819]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 06 10:39:47 devstack cinder-volume[86819]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 10:39:47 devstack cinder-volume[86819]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 06 10:39:47 devstack cinder-volume[86819]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 06 10:39:47 devstack cinder-volume[86819]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 10:39:47 devstack cinder-volume[86819]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 10:39:47 devstack cinder-volume[86819]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 06 10:39:48 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root Nov 06 10:39:48 devstack cinder-volume[86819]: INFO oslo.privsep.daemon [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Spawned new privsep daemon via rootwrap Nov 06 10:39:48 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Accepted privsep connection to /tmp/tmp9la4a5mx/privsep.sock {{(pid=86819) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 06 10:39:48 devstack cinder-volume[86819]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 06 10:39:48 devstack cinder-volume[86819]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 06 10:39:48 devstack cinder-volume[86819]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 06 10:39:48 devstack cinder-volume[86819]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88666 Nov 06 10:39:48 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96205f1-cb78-442f-ace2-069c21248849]: (2,) {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:39:48 devstack cinder-volume[86819]: WARNING oslo_privsep.priv_context [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] privsep daemon already running Nov 06 10:39:48 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5732cb55-dece-450b-b2bd-416b8d839245]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:39:48 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7ea80c-c543-406b-a24b-30c6f3a1dce2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:39:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:39:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c0cf2115-8787-4b05-acc4-08429e2792d7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:39:48 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f Nov 06 10:39:48 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:39:48 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c0cf2115-8787-4b05-acc4-08429e2792d7 Nov 06 10:39:48 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:39:49 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Nov 06 10:39:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f" returned: 0 in 1.130s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:39:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:39:49 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f Nov 06 10:39:49 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:39:49 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Nov 06 10:39:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c0cf2115-8787-4b05-acc4-08429e2792d7" returned: 0 in 1.448s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:39:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c0cf2115-8787-4b05-acc4-08429e2792d7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:39:49 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c0cf2115-8787-4b05-acc4-08429e2792d7 Nov 06 10:39:49 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:39:50 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Nov 06 10:39:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5cadae32-b8cd-479d-a44b-1cb8f417a30f" returned: 0 in 0.595s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:39:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Lock "cinder-quobyte-5cadae32-b8cd-479d-a44b-1cb8f417a30f" released by "delete_volume" :: held 3.031s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:39:50 devstack cinder-volume[86819]: WARNING cinder.quota [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:39:50 devstack cinder-volume[86819]: WARNING cinder.quota [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:39:50 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Created reservations ['b963ab87-c83f-4af3-b6e3-0a777e6cc24d', '22a63ff3-15e2-44a2-8602-6c9ce2db8925', 'a0f68c30-e2de-4123-832a-8ac9314a1dae', 'f7a4746b-8f0d-4acb-8b5e-175900e3939b'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:39:50 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Nov 06 10:39:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c0cf2115-8787-4b05-acc4-08429e2792d7" returned: 0 in 0.633s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:39:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Lock "cinder-quobyte-c0cf2115-8787-4b05-acc4-08429e2792d7" released by "delete_volume" :: held 5.212s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:39:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:39:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:39:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:39:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:39:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:39:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:39:51 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:39:51 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:39:51 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Created reservations ['4dc3fe9d-f071-40c8-862c-256742138eaf', 'b65cae8f-9718-48d8-932a-b0f23d5e7f41', 'c5cfa773-cce4-4d94-95df-2ee51bb3816b', 'eed6755c-743b-48d4-8a67-eb0c90d1e78f'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:39:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:39:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:39:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:39:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:39:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:39:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:39:51 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:39:51 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:39:51 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Nov 06 10:39:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.504s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:39:51 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:39:51 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Deleted volume successfully. Nov 06 10:39:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f47aad06-d82e-4529-be25-328074fbf793 tempest-DeleteServersTestJSON-965579767 None] Lock "cinder-5cadae32-b8cd-479d-a44b-1cb8f417a30f-delete_volume" released by "delete_volume" :: held 4.580s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:39:52 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Nov 06 10:39:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.720s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:39:52 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:39:52 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Deleted volume successfully. Nov 06 10:39:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a169e0e1-4075-4c01-87d1-6cf603a55420 tempest-VolumesAdminNegativeTest-1072347252 None] Lock "cinder-c0cf2115-8787-4b05-acc4-08429e2792d7-delete_volume" released by "delete_volume" :: held 7.009s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:40:01 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=20,cinder:UPDATE=26,cinder:DELETE=4,cinder:INSERT=5 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:40:02 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=27,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:40:15 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Acquiring lock "cinder-8221a2cb-7dbb-4f31-af68-445f3b658240-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:40:15 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Lock "cinder-8221a2cb-7dbb-4f31-af68-445f3b658240-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:40:15 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Acquiring lock "cinder-quobyte-8221a2cb-7dbb-4f31-af68-445f3b658240" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:40:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Lock "cinder-quobyte-8221a2cb-7dbb-4f31-af68-445f3b658240" acquired by "delete_volume" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:40:16 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1eca51-e956-431e-8497-0b675e7ceca8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:40:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8221a2cb-7dbb-4f31-af68-445f3b658240 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:40:16 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8221a2cb-7dbb-4f31-af68-445f3b658240 Nov 06 10:40:16 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:40:16 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Nov 06 10:40:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8221a2cb-7dbb-4f31-af68-445f3b658240" returned: 0 in 0.598s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:40:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8221a2cb-7dbb-4f31-af68-445f3b658240 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:40:16 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8221a2cb-7dbb-4f31-af68-445f3b658240 Nov 06 10:40:16 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:40:16 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Nov 06 10:40:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8221a2cb-7dbb-4f31-af68-445f3b658240" returned: 0 in 0.312s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:40:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Lock "cinder-quobyte-8221a2cb-7dbb-4f31-af68-445f3b658240" released by "delete_volume" :: held 0.974s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:40:17 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Created reservations ['c438daae-3dd5-4cdf-a4c6-11aab04fdfac', 'ece7a925-a376-4c16-a999-bf835bcd7a46', 'e701af40-4493-480f-a65c-649fb1219b2e', '55107ea8-73e2-4f25-b3c7-ef3c432594c2'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:40:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:40:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:40:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:40:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:40:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:40:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:40:17 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:40:17 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:40:17 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Nov 06 10:40:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.440s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:40:17 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:40:17 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Deleted volume successfully. Nov 06 10:40:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-51925e45-6b42-41aa-865e-326fb8f27fd2 tempest-ServerRescueNegativeTestJSON-1382760736 None] Lock "cinder-8221a2cb-7dbb-4f31-af68-445f3b658240-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:40:27 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=8,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:40:27 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=3,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:40:32 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Flow 'volume_create_manager' (6eb0377e-f8d8-4aa7-a415-a59d77b2cc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4013ca38-49c3-490f-ad3c-d5001d9c8dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4013ca38-49c3-490f-ad3c-d5001d9c8dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1177674121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='628771481f9242d386123a6b69105b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:40:33Z,use_quota=True,user_id='820992fbf5d0490386457dcfa0e98666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abef6bf-83de-46c3-880b-3458d9191e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abef6bf-83de-46c3-880b-3458d9191e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69492a96-baa3-434c-9ef3-15ae140d8d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69492a96-baa3-434c-9ef3-15ae140d8d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c', 'volume_name': 'volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ade4fd-d026-49fd-bbaa-d1301829bc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ade4fd-d026-49fd-bbaa-d1301829bc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e8d029-c7ac-4605-a22b-b3c3117a09b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:40:33 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Volume 8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c', 'volume_size': 1} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1177674121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='628771481f9242d386123a6b69105b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:40:33Z,use_quota=True,user_id='820992fbf5d0490386457dcfa0e98666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Creating volume 8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:40:33 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:40:33 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c 1073741824 Nov 06 10:40:33 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:40:33 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c 1073741824" returned: 0 in 0.602s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:40:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:40:33 devstack sudo[88955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c Nov 06 10:40:33 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:40:34 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root Nov 06 10:40:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c" returned: 0 in 0.383s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:40:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:40:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:40:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e8d029-c7ac-4605-a22b-b3c3117a09b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:40:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ab5eb5-39eb-4595-8a43-8b94b033f3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:40:34 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Volume volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c (8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c): created successfully Nov 06 10:40:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ab5eb5-39eb-4595-8a43-8b94b033f3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:40:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Flow 'volume_create_manager' (6eb0377e-f8d8-4aa7-a415-a59d77b2cc4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:40:34 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-6d8142a9-43ae-4b1b-93c4-2336324b16cc tempest-TaggedAttachmentsTest-453597098 None] Created volume successfully. Nov 06 10:40:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:40:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:40:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:40:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:40:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:40:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:40:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:40:36 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:40:36 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:40:36 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Nov 06 10:40:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.320s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:40:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:40:44 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:40:44 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:41:22 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:41:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Flow 'volume_create_manager' (304d49e0-fb52-410b-b2a3-107ffdfb7864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d20ffe-6fb9-4049-8982-3e13a13e980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d20ffe-6fb9-4049-8982-3e13a13e980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-77635210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59607a6-afb3-4d46-b59f-6473c776cd2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c74c4619ce4ca2a812a16f1a29cb09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:41:23Z,use_quota=True,user_id='19478cda773a4e49a0bff688c38451a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b64d65-62ac-4dd5-8b72-70cd5d9f389b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b64d65-62ac-4dd5-8b72-70cd5d9f389b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954d4a62-9831-4b7d-9391-0270daa25b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954d4a62-9831-4b7d-9391-0270daa25b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e59607a6-afb3-4d46-b59f-6473c776cd2f', 'volume_name': 'volume-e59607a6-afb3-4d46-b59f-6473c776cd2f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c38fbc-eda1-4846-8524-380469457521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c38fbc-eda1-4846-8524-380469457521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8aa2cd3-c86f-4627-b705-f40bcf4fc227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:23 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Volume e59607a6-afb3-4d46-b59f-6473c776cd2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e59607a6-afb3-4d46-b59f-6473c776cd2f', 'volume_size': 1} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-77635210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59607a6-afb3-4d46-b59f-6473c776cd2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c74c4619ce4ca2a812a16f1a29cb09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:41:23Z,use_quota=True,user_id='19478cda773a4e49a0bff688c38451a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Creating volume e59607a6-afb3-4d46-b59f-6473c776cd2f {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:41:23 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:41:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e59607a6-afb3-4d46-b59f-6473c776cd2f 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:23 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e59607a6-afb3-4d46-b59f-6473c776cd2f 1073741824 Nov 06 10:41:23 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:24 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e59607a6-afb3-4d46-b59f-6473c776cd2f 1073741824" returned: 0 in 0.801s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e59607a6-afb3-4d46-b59f-6473c776cd2f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:24 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e59607a6-afb3-4d46-b59f-6473c776cd2f Nov 06 10:41:24 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:24 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e59607a6-afb3-4d46-b59f-6473c776cd2f" returned: 0 in 0.602s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:41:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:41:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8aa2cd3-c86f-4627-b705-f40bcf4fc227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e59607a6-afb3-4d46-b59f-6473c776cd2f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b18c03-f454-4115-a298-e2e1f883e480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:24 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Volume volume-e59607a6-afb3-4d46-b59f-6473c776cd2f (e59607a6-afb3-4d46-b59f-6473c776cd2f): created successfully Nov 06 10:41:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b18c03-f454-4115-a298-e2e1f883e480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Flow 'volume_create_manager' (304d49e0-fb52-410b-b2a3-107ffdfb7864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:41:24 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-57c97a60-5b2e-47d0-90d7-15158f9042f0 tempest-ServersNegativeTestJSON-126413020 None] Created volume successfully. Nov 06 10:41:26 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:41:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Flow 'volume_create_manager' (53ee5b23-4ddf-47de-80c1-5114834b0562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb935b6-2da8-4bb0-ae81-c7e26c6ad228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb935b6-2da8-4bb0-ae81-c7e26c6ad228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-986388504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ea81d2-7cf0-4ed6-9900-bbff90b73b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c74c4619ce4ca2a812a16f1a29cb09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:41:27Z,use_quota=True,user_id='19478cda773a4e49a0bff688c38451a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f410e7-4006-4a0e-89d6-29ab258e34f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f410e7-4006-4a0e-89d6-29ab258e34f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc44f35-ccba-4c5f-a3fb-b14c5e6b07c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc44f35-ccba-4c5f-a3fb-b14c5e6b07c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01ea81d2-7cf0-4ed6-9900-bbff90b73b71', 'volume_name': 'volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3f12a1-1398-43c7-b8f2-fab9833a2747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3f12a1-1398-43c7-b8f2-fab9833a2747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ba687c-e63f-4201-848e-ad805bac0362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:27 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Volume 01ea81d2-7cf0-4ed6-9900-bbff90b73b71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71', 'volume_size': 1} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-986388504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ea81d2-7cf0-4ed6-9900-bbff90b73b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c74c4619ce4ca2a812a16f1a29cb09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:41:27Z,use_quota=True,user_id='19478cda773a4e49a0bff688c38451a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Creating volume 01ea81d2-7cf0-4ed6-9900-bbff90b73b71 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:41:27 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:27 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71 1073741824 Nov 06 10:41:27 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:27 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71 1073741824" returned: 0 in 0.458s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:27 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71 Nov 06 10:41:27 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:27 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71" returned: 0 in 0.255s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ba687c-e63f-4201-848e-ad805bac0362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd373bc-158a-4891-bbe2-b0b833798eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:27 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Volume volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71 (01ea81d2-7cf0-4ed6-9900-bbff90b73b71): created successfully Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd373bc-158a-4891-bbe2-b0b833798eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Flow 'volume_create_manager' (53ee5b23-4ddf-47de-80c1-5114834b0562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:41:27 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5322d6f5-d924-4e62-94d9-e81adf643c3d tempest-ServersNegativeTestJSON-126413020 None] Created volume successfully. Nov 06 10:41:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Acquiring lock "cinder-01ea81d2-7cf0-4ed6-9900-bbff90b73b71-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:41:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Lock "cinder-01ea81d2-7cf0-4ed6-9900-bbff90b73b71-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:41:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Acquiring lock "cinder-quobyte-01ea81d2-7cf0-4ed6-9900-bbff90b73b71" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:41:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Lock "cinder-quobyte-01ea81d2-7cf0-4ed6-9900-bbff90b73b71" acquired by "delete_volume" :: waited 0.034s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:41:28 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed61edea-bb69-4d18-a782-a5529ba5fed9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:41:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:28 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71 Nov 06 10:41:28 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:29 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71" returned: 0 in 0.401s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:29 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71 Nov 06 10:41:29 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:29 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01ea81d2-7cf0-4ed6-9900-bbff90b73b71" returned: 0 in 0.266s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Lock "cinder-quobyte-01ea81d2-7cf0-4ed6-9900-bbff90b73b71" released by "delete_volume" :: held 0.736s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Created reservations ['fd27bfcf-a825-45cd-807b-d827513870bc', '5467473d-99f7-48dc-8898-af45926090a5', '77353912-da1f-4ce0-a639-536697dcc540', 'bef83ad0-74b3-4c25-a375-c24ff9801110'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:29 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:41:29 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:29 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Acquiring lock "cinder-e59607a6-afb3-4d46-b59f-6473c776cd2f-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.284s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:41:29 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Deleted volume successfully. Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Lock "cinder-e59607a6-afb3-4d46-b59f-6473c776cd2f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-87325e19-457c-4bf9-b200-0c36162cd89f tempest-ServersNegativeTestJSON-126413020 None] Lock "cinder-01ea81d2-7cf0-4ed6-9900-bbff90b73b71-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Acquiring lock "cinder-quobyte-e59607a6-afb3-4d46-b59f-6473c776cd2f" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Lock "cinder-quobyte-e59607a6-afb3-4d46-b59f-6473c776cd2f" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[46377764-d78e-4ced-ba37-ad2bf64cc219]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:41:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e59607a6-afb3-4d46-b59f-6473c776cd2f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:30 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e59607a6-afb3-4d46-b59f-6473c776cd2f Nov 06 10:41:30 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:30 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e59607a6-afb3-4d46-b59f-6473c776cd2f" returned: 0 in 0.608s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e59607a6-afb3-4d46-b59f-6473c776cd2f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:30 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e59607a6-afb3-4d46-b59f-6473c776cd2f Nov 06 10:41:30 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:30 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e59607a6-afb3-4d46-b59f-6473c776cd2f" returned: 0 in 0.321s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Lock "cinder-quobyte-e59607a6-afb3-4d46-b59f-6473c776cd2f" released by "delete_volume" :: held 0.989s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:41:30 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Created reservations ['8dad585b-c155-4bc3-9c16-a518a4ca1601', 'a12aee63-cd50-4e57-ac43-2280755b2381', '38dcb8fc-1804-4bb4-9bdd-8645f098a9b7', '539f4faa-dd6b-4492-8656-8e6c2bd9ee8c'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:41:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:41:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:41:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:41:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:41:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:41:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:31 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:41:31 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:31 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.410s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:31 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:41:31 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Deleted volume successfully. Nov 06 10:41:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e98073ed-0566-4925-b133-e9c1ccdb8ae9 tempest-ServersNegativeTestJSON-126413020 None] Lock "cinder-e59607a6-afb3-4d46-b59f-6473c776cd2f-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:41:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:41:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:41:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:41:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:41:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:41:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:41:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:36 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:41:36 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:36 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.514s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:41:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:41:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 8 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:41:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:41:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-afbec2c0-f8f8-44bf-bf1b-71c865989734 req-464e507b-2c19-4692-a0b3-304f0683dc5c tempest-TaggedAttachmentsTest-453597098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:41:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-afbec2c0-f8f8-44bf-bf1b-71c865989734 req-464e507b-2c19-4692-a0b3-304f0683dc5c tempest-TaggedAttachmentsTest-453597098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:41:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-afbec2c0-f8f8-44bf-bf1b-71c865989734 req-464e507b-2c19-4692-a0b3-304f0683dc5c tempest-TaggedAttachmentsTest-453597098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:41:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-afbec2c0-f8f8-44bf-bf1b-71c865989734 req-464e507b-2c19-4692-a0b3-304f0683dc5c tempest-TaggedAttachmentsTest-453597098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd76f621-ceb4-4928-9403-0b17cc76bad7', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:41:38 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-afbec2c0-f8f8-44bf-bf1b-71c865989734 req-464e507b-2c19-4692-a0b3-304f0683dc5c tempest-TaggedAttachmentsTest-453597098 None] attachment_update completed successfully. Nov 06 10:41:41 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-1eb19471-c398-4a0d-b9f4-4a8d53345896 req-4ed0d2ef-763d-42df-bd6c-3e4ab3caec25 tempest-TaggedAttachmentsTest-453597098 None] Terminate volume connection completed successfully. Nov 06 10:41:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-1eb19471-c398-4a0d-b9f4-4a8d53345896 req-4ed0d2ef-763d-42df-bd6c-3e4ab3caec25 tempest-TaggedAttachmentsTest-453597098 None] Deleting attachment dd76f621-ceb4-4928-9403-0b17cc76bad7. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Flow 'volume_create_manager' (ba2ef740-ea66-478a-b013-35f92d4d802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a17c97-5524-41f2-85ab-e2781928605f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a17c97-5524-41f2-85ab-e2781928605f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1622897928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe19a64a-30a0-44c8-83da-9e8403dc5299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27898add2c84a8f9b87ba04ff576445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:41:45Z,use_quota=True,user_id='b6388a8b9537492ca575582ec6c64462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783cd280-bb0c-4204-915a-5275cc2eb3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783cd280-bb0c-4204-915a-5275cc2eb3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0ba932-f8ba-4f81-86b6-70caabb7c572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0ba932-f8ba-4f81-86b6-70caabb7c572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe19a64a-30a0-44c8-83da-9e8403dc5299', 'volume_name': 'volume-fe19a64a-30a0-44c8-83da-9e8403dc5299', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc43077-635e-4cc7-b02f-79de41472aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc43077-635e-4cc7-b02f-79de41472aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a3f366-8c94-4cc5-a717-93b745270060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:45 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Volume fe19a64a-30a0-44c8-83da-9e8403dc5299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe19a64a-30a0-44c8-83da-9e8403dc5299', 'volume_size': 1} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1622897928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe19a64a-30a0-44c8-83da-9e8403dc5299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27898add2c84a8f9b87ba04ff576445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:41:45Z,use_quota=True,user_id='b6388a8b9537492ca575582ec6c64462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Creating volume fe19a64a-30a0-44c8-83da-9e8403dc5299 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:41:45 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fe19a64a-30a0-44c8-83da-9e8403dc5299 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:45 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fe19a64a-30a0-44c8-83da-9e8403dc5299 1073741824 Nov 06 10:41:45 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:45 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fe19a64a-30a0-44c8-83da-9e8403dc5299 1073741824" returned: 0 in 0.649s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fe19a64a-30a0-44c8-83da-9e8403dc5299 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:45 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fe19a64a-30a0-44c8-83da-9e8403dc5299 Nov 06 10:41:45 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:46 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fe19a64a-30a0-44c8-83da-9e8403dc5299" returned: 0 in 0.447s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a3f366-8c94-4cc5-a717-93b745270060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe19a64a-30a0-44c8-83da-9e8403dc5299', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d944a91a-06c4-4377-9d2d-0825bac40556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Flow 'volume_create_manager' (a430df0a-2df0-47d5-b358-64747d698566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3fdfb11-60d5-4a61-9d44-87fe8c523adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:46 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Volume volume-fe19a64a-30a0-44c8-83da-9e8403dc5299 (fe19a64a-30a0-44c8-83da-9e8403dc5299): created successfully Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d944a91a-06c4-4377-9d2d-0825bac40556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Flow 'volume_create_manager' (ba2ef740-ea66-478a-b013-35f92d4d802b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3fdfb11-60d5-4a61-9d44-87fe8c523adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1981372845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a786a48-a5f1-467d-86ef-4756754aaacf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f8ec7a55aba45dbb20dc496ac8d4188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:41:46Z,use_quota=True,user_id='9ad77a30e87f408cb447022631eb827f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21530794-1945-4382-9e02-397a36c51c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21530794-1945-4382-9e02-397a36c51c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2071ea7-d067-45f4-b2b9-2b065b7f2619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2071ea7-d067-45f4-b2b9-2b065b7f2619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a786a48-a5f1-467d-86ef-4756754aaacf', 'volume_name': 'volume-2a786a48-a5f1-467d-86ef-4756754aaacf', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7d9f50-a3c0-45e5-80f1-8587470f2e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7d9f50-a3c0-45e5-80f1-8587470f2e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1970cc6-2aa1-4ac6-9c25-0af927ab464f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:46 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Volume 2a786a48-a5f1-467d-86ef-4756754aaacf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a786a48-a5f1-467d-86ef-4756754aaacf', 'volume_size': 1} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1981372845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a786a48-a5f1-467d-86ef-4756754aaacf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f8ec7a55aba45dbb20dc496ac8d4188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:41:46Z,use_quota=True,user_id='9ad77a30e87f408cb447022631eb827f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Creating volume 2a786a48-a5f1-467d-86ef-4756754aaacf {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:41:46 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:41:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2a786a48-a5f1-467d-86ef-4756754aaacf 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:46 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-42e1291f-6084-4783-be6d-abd85d77924f tempest-ServerActionsTestOtherA-1183418255 None] Created volume successfully. Nov 06 10:41:46 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2a786a48-a5f1-467d-86ef-4756754aaacf 1073741824 Nov 06 10:41:46 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:47 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2a786a48-a5f1-467d-86ef-4756754aaacf 1073741824" returned: 0 in 0.754s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2a786a48-a5f1-467d-86ef-4756754aaacf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:47 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2a786a48-a5f1-467d-86ef-4756754aaacf Nov 06 10:41:47 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:47 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2a786a48-a5f1-467d-86ef-4756754aaacf" returned: 0 in 0.375s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:41:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:41:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1970cc6-2aa1-4ac6-9c25-0af927ab464f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a786a48-a5f1-467d-86ef-4756754aaacf', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e468bb65-a306-4d1b-8c4f-a7abd2a710e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:41:47 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Volume volume-2a786a48-a5f1-467d-86ef-4756754aaacf (2a786a48-a5f1-467d-86ef-4756754aaacf): created successfully Nov 06 10:41:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e468bb65-a306-4d1b-8c4f-a7abd2a710e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:41:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Flow 'volume_create_manager' (a430df0a-2df0-47d5-b358-64747d698566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:41:47 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-4d57a1a1-c825-4d09-9cae-6b8c1abdc0bb tempest-AttachVolumeTestJSON-723569238 None] Created volume successfully. Nov 06 10:41:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-2d16474d-83e3-4d08-97dd-6a7b437edbe8 req-52a7a8a2-31f9-45a9-b3fc-d240edeac591 tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:41:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-2d16474d-83e3-4d08-97dd-6a7b437edbe8 req-52a7a8a2-31f9-45a9-b3fc-d240edeac591 tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:41:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-2d16474d-83e3-4d08-97dd-6a7b437edbe8 req-52a7a8a2-31f9-45a9-b3fc-d240edeac591 tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:41:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-2d16474d-83e3-4d08-97dd-6a7b437edbe8 req-52a7a8a2-31f9-45a9-b3fc-d240edeac591 tempest-AttachVolumeTestJSON-723569238 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-2a786a48-a5f1-467d-86ef-4756754aaacf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9e62fb7-d383-4b52-858a-6c7a0d9dee7b', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:41:50 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-2d16474d-83e3-4d08-97dd-6a7b437edbe8 req-52a7a8a2-31f9-45a9-b3fc-d240edeac591 tempest-AttachVolumeTestJSON-723569238 None] attachment_update completed successfully. Nov 06 10:41:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Acquiring lock "cinder-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:41:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Lock "cinder-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:41:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Acquiring lock "cinder-quobyte-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:41:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Lock "cinder-quobyte-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c" acquired by "delete_volume" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:41:58 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6065e66-20d6-4610-8eba-7baf62ffb6fa]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:41:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:58 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c Nov 06 10:41:58 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:58 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c" returned: 0 in 0.424s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:58 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c Nov 06 10:41:58 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:59 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c" returned: 0 in 0.270s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Lock "cinder-quobyte-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c" released by "delete_volume" :: held 0.751s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:41:59 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Created reservations ['d5a59d9b-b340-49c4-a8a0-8a849b06d74c', '8ea53969-d3c5-4927-bffc-613e607b9a5b', '3b52eec3-cbf6-4e91-9835-9584bef7ac76', '85778d09-1629-4e37-b8b0-aa73ca907db4'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:41:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:41:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:41:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:41:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:41:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:41:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:41:59 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:41:59 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:41:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.336s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:41:59 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Nov 06 10:41:59 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:41:59 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Deleted volume successfully. Nov 06 10:41:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-29596085-17c8-4d2d-93df-dc766dcdc8d3 tempest-TaggedAttachmentsTest-453597098 None] Lock "cinder-8f1449b9-cecd-4ee8-b8b1-4514c7c69d6c-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:42:19 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=35,cinder:UPDATE=40,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:42:19 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=39,cinder:SELECT=40,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Flow 'volume_create_manager' (15729a66-27ce-43db-9469-5b66e32f0b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1cf021-7f1c-43aa-95dd-9e04c2d0ae3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1cf021-7f1c-43aa-95dd-9e04c2d0ae3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1325391150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1083b9-a5c8-4100-bc02-b9d69e38d04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='423663a847744f54845442c46cb38a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:42:23Z,use_quota=True,user_id='57ebdc682bb14d13972a1e69d01fe1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6531baca-9917-4cfc-933c-e2c6c315cf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6531baca-9917-4cfc-933c-e2c6c315cf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67da9a5d-a164-41f5-a9c9-2e4f3800a471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67da9a5d-a164-41f5-a9c9-2e4f3800a471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1083b9-a5c8-4100-bc02-b9d69e38d04d', 'volume_name': 'volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e41d32f-9895-4482-a6a5-0f8390e038cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e41d32f-9895-4482-a6a5-0f8390e038cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23ff380-429a-4c0f-a649-754eebdb4512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:22 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Volume 2f1083b9-a5c8-4100-bc02-b9d69e38d04d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d', 'volume_size': 1} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1325391150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1083b9-a5c8-4100-bc02-b9d69e38d04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='423663a847744f54845442c46cb38a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:42:23Z,use_quota=True,user_id='57ebdc682bb14d13972a1e69d01fe1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Creating volume 2f1083b9-a5c8-4100-bc02-b9d69e38d04d {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:42:22 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:42:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:22 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d 1073741824 Nov 06 10:42:22 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:23 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d 1073741824" returned: 0 in 0.467s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:23 devstack sudo[91578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d Nov 06 10:42:23 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:23 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d" returned: 0 in 0.287s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:42:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:42:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23ff380-429a-4c0f-a649-754eebdb4512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63fd818-479e-4f46-82c3-1449fda34c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:23 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Volume volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d (2f1083b9-a5c8-4100-bc02-b9d69e38d04d): created successfully Nov 06 10:42:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63fd818-479e-4f46-82c3-1449fda34c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Flow 'volume_create_manager' (15729a66-27ce-43db-9469-5b66e32f0b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:42:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-ab4416f5-6143-4336-96bd-c71277b3d95b req-5524aba1-b90e-463d-aed1-f20a70f101bd tempest-VolumesSnapshotsTestJSON-1201170161 None] Created volume successfully. Nov 06 10:42:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:42:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:42:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] Creating offline snapshot 822611d1-687b-463d-8cb1-a3a881a3047d of volume 2f1083b9-a5c8-4100-bc02-b9d69e38d04d {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:42:24 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1798417e-1004-499b-9f55-31612d46c76c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:42:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:24 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d Nov 06 10:42:24 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:24 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d" returned: 0 in 0.441s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:24 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d 1G Nov 06 10:42:24 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:24 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d 1G" returned: 0 in 0.405s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:24 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d Nov 06 10:42:24 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:25 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d" returned: 0 in 0.297s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:25 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d is being set with open permissions: ugo+rw Nov 06 10:42:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:25 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d Nov 06 10:42:25 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:25 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d" returned: 0 in 0.253s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:25 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.info Nov 06 10:42:25 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:25 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.info" returned: 0 in 0.269s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:25 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.info is being set with open permissions: ugo+rw Nov 06 10:42:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:25 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.info Nov 06 10:42:25 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:26 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.info" returned: 0 in 0.255s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:42:26 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-bfbd77e9-da40-457e-85dd-a1a95b38bc0c req-a9d6495c-84f4-44b6-bb04-9406875f81a3 tempest-VolumesSnapshotsTestJSON-1201170161 None] Create snapshot completed successfully Nov 06 10:42:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Acquiring lock "cinder-822611d1-687b-463d-8cb1-a3a881a3047d-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:42:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "cinder-822611d1-687b-463d-8cb1-a3a881a3047d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:42:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Acquiring lock "cinder-quobyte-2f1083b9-a5c8-4100-bc02-b9d69e38d04d" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:42:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "cinder-quobyte-2f1083b9-a5c8-4100-bc02-b9d69e38d04d" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:42:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Acquiring lock "cinder-quobyte-822611d1-687b-463d-8cb1-a3a881a3047d" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:42:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "cinder-quobyte-822611d1-687b-463d-8cb1-a3a881a3047d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:42:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Deleting offline snapshot 822611d1-687b-463d-8cb1-a3a881a3047d of volume 2f1083b9-a5c8-4100-bc02-b9d69e38d04d {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:42:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] snapshot_file for this snap is: volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:42:26 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8446e2d-f327-4a67-88d8-6d1148e6b5f5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:42:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:26 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d Nov 06 10:42:26 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:27 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d" returned: 0 in 0.380s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:42:27 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94607ab-3bb0-4d3a-bcd3-977c012ded8a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:42:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:27 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d Nov 06 10:42:27 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:27 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d" returned: 0 in 0.414s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:27 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d Nov 06 10:42:27 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:27 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d" returned: 0 in 0.396s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:27 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d Nov 06 10:42:27 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:28 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d.822611d1-687b-463d-8cb1-a3a881a3047d" returned: 0 in 0.337s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "cinder-quobyte-822611d1-687b-463d-8cb1-a3a881a3047d" released by "_delete_snapshot" :: held 1.673s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:42:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "cinder-quobyte-2f1083b9-a5c8-4100-bc02-b9d69e38d04d" released by "delete_snapshot" :: held 1.709s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:42:28 devstack cinder-volume[86819]: WARNING cinder.quota [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:42:28 devstack cinder-volume[86819]: DEBUG cinder.quota [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Created reservations ['ebef1dce-e641-46c8-a15b-26e4aab28e1e', 'b279ff49-bf03-4270-8d20-6222e71e87a0', 'f8ca6d3e-0584-4b0c-9623-1405f7008142', '311b2a85-3ed7-479e-98d8-f83f91f135c0'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:42:28 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Delete snapshot completed successfully. Nov 06 10:42:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-fbf039a3-3531-4fec-8e81-d544c9cde9e3 req-2a679d4c-a3a5-4761-8ed6-8e8b3dd312ab tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "cinder-822611d1-687b-463d-8cb1-a3a881a3047d-delete_snapshot" released by "delete_snapshot" :: held 1.984s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:42:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Acquiring lock "cinder-2f1083b9-a5c8-4100-bc02-b9d69e38d04d-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:42:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "cinder-2f1083b9-a5c8-4100-bc02-b9d69e38d04d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:42:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Acquiring lock "cinder-quobyte-2f1083b9-a5c8-4100-bc02-b9d69e38d04d" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:42:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "cinder-quobyte-2f1083b9-a5c8-4100-bc02-b9d69e38d04d" acquired by "delete_volume" :: waited 0.050s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:42:29 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-0622522f-3439-4153-8f3a-cfd21f72f2b0 req-a5193058-1040-4817-b249-7e8806f14157 tempest-AttachVolumeTestJSON-723569238 None] Terminate volume connection completed successfully. Nov 06 10:42:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0622522f-3439-4153-8f3a-cfd21f72f2b0 req-a5193058-1040-4817-b249-7e8806f14157 tempest-AttachVolumeTestJSON-723569238 None] Deleting attachment d9e62fb7-d383-4b52-858a-6c7a0d9dee7b. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:42:29 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[690465a1-915a-4ad8-baad-62ceb4812e67]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:42:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:29 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d Nov 06 10:42:29 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-37c881f2-6e05-4708-adaa-351034f5ca43 req-a3d898b2-4a00-4205-91df-1fa77e2a1732 tempest-ServerActionsTestOtherA-1183418255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:42:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-37c881f2-6e05-4708-adaa-351034f5ca43 req-a3d898b2-4a00-4205-91df-1fa77e2a1732 tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:42:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-37c881f2-6e05-4708-adaa-351034f5ca43 req-a3d898b2-4a00-4205-91df-1fa77e2a1732 tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:42:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-37c881f2-6e05-4708-adaa-351034f5ca43 req-a3d898b2-4a00-4205-91df-1fa77e2a1732 tempest-ServerActionsTestOtherA-1183418255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-fe19a64a-30a0-44c8-83da-9e8403dc5299', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a77cdd99-09ca-466d-96ad-d73d8e832299', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:42:29 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d" returned: 0 in 0.525s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:29 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d Nov 06 10:42:29 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:29 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-37c881f2-6e05-4708-adaa-351034f5ca43 req-a3d898b2-4a00-4205-91df-1fa77e2a1732 tempest-ServerActionsTestOtherA-1183418255 None] attachment_update completed successfully. Nov 06 10:42:30 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2f1083b9-a5c8-4100-bc02-b9d69e38d04d" returned: 0 in 0.391s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "cinder-quobyte-2f1083b9-a5c8-4100-bc02-b9d69e38d04d" released by "delete_volume" :: held 1.028s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:42:30 devstack cinder-volume[86819]: DEBUG cinder.quota [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Created reservations ['1d2e64ca-bb5f-4a4a-a130-4d34fe435444', 'abafebb7-a584-42c4-a8d0-b083cc445440', 'eee5c752-78a1-4509-8008-85235535a6ba', '397e8a81-e7ab-48d4-8793-30197111fe71'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:42:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:42:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:42:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:42:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:42:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:42:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:30 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:42:30 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:30 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.273s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:30 devstack cinder-volume[86819]: DEBUG cinder.manager [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:42:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Deleted volume successfully. Nov 06 10:42:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-38f5c0cb-91b3-47dd-ac45-44a7be079dc6 req-375b76b7-ef5e-4a7e-80df-b10e3bfd4c91 tempest-VolumesSnapshotsTestJSON-1201170161 None] Lock "cinder-2f1083b9-a5c8-4100-bc02-b9d69e38d04d-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:42:34 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-1510f845-6c53-495c-8d07-89eef001ffd6 req-545425f4-fd36-4ff8-a0de-479c48560bde tempest-ServerActionsTestOtherA-1183418255 None] Terminate volume connection completed successfully. Nov 06 10:42:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-1510f845-6c53-495c-8d07-89eef001ffd6 req-545425f4-fd36-4ff8-a0de-479c48560bde tempest-ServerActionsTestOtherA-1183418255 None] Deleting attachment a77cdd99-09ca-466d-96ad-d73d8e832299. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:42:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-1510f845-6c53-495c-8d07-89eef001ffd6 req-a6afadd9-83cf-46c5-b9de-bea7272bc558 tempest-ServerActionsTestOtherA-1183418255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:42:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-1510f845-6c53-495c-8d07-89eef001ffd6 req-a6afadd9-83cf-46c5-b9de-bea7272bc558 tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:42:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-1510f845-6c53-495c-8d07-89eef001ffd6 req-a6afadd9-83cf-46c5-b9de-bea7272bc558 tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:42:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-1510f845-6c53-495c-8d07-89eef001ffd6 req-a6afadd9-83cf-46c5-b9de-bea7272bc558 tempest-ServerActionsTestOtherA-1183418255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-fe19a64a-30a0-44c8-83da-9e8403dc5299', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5ef6e4a-ad75-45c1-8861-dc007cca603a', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:42:35 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-1510f845-6c53-495c-8d07-89eef001ffd6 req-a6afadd9-83cf-46c5-b9de-bea7272bc558 tempest-ServerActionsTestOtherA-1183418255 None] attachment_update completed successfully. Nov 06 10:42:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:42:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:42:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:42:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:42:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:42:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:42:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:36 devstack sudo[92266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:42:36 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:36 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.618s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:42:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:42:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 8 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:42:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:42:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e1615719-6e44-4c18-bb62-108b5307ef2a tempest-BackendsCapabilitiesAdminTestsJSON-1008085724 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3973922729492, 'free_capacity_gb': 1773.3973922729492, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86819) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 10:42:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f2a57531-0867-4035-acb6-1e9d364580ea tempest-BackendsCapabilitiesAdminTestsJSON-1008085724 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3973922729492, 'free_capacity_gb': 1773.3973922729492, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86819) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 10:42:40 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:42:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Flow 'volume_create_manager' (23c4ebce-8041-4ed9-a177-aa1a44fe62c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:42:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0198c7e-70bc-4cb7-9ed0-fc1bb2c244eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0198c7e-70bc-4cb7-9ed0-fc1bb2c244eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1377977941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332258fc-b1db-43d1-9645-163db470fdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7e034a0872547f5b93c7b9a84218b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:42:41Z,use_quota=True,user_id='6e3a9d3d96d54ae0bb2e68bc22e2c7c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b1285b-80df-4c4d-b761-29693dc49409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b1285b-80df-4c4d-b761-29693dc49409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fae894-be59-4178-a8e5-852101cf7617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fae894-be59-4178-a8e5-852101cf7617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '332258fc-b1db-43d1-9645-163db470fdfc', 'volume_name': 'volume-332258fc-b1db-43d1-9645-163db470fdfc', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1126ec4c-7a96-46d7-b50d-bb58109a43ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1126ec4c-7a96-46d7-b50d-bb58109a43ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c251c5c3-6e54-4748-b5fb-7aa7a0c8b564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:41 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Volume 332258fc-b1db-43d1-9645-163db470fdfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-332258fc-b1db-43d1-9645-163db470fdfc', 'volume_size': 1} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1377977941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332258fc-b1db-43d1-9645-163db470fdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7e034a0872547f5b93c7b9a84218b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:42:41Z,use_quota=True,user_id='6e3a9d3d96d54ae0bb2e68bc22e2c7c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Creating volume 332258fc-b1db-43d1-9645-163db470fdfc {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:42:41 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-332258fc-b1db-43d1-9645-163db470fdfc 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:41 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-332258fc-b1db-43d1-9645-163db470fdfc 1073741824 Nov 06 10:42:41 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:41 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-332258fc-b1db-43d1-9645-163db470fdfc 1073741824" returned: 0 in 0.800s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-332258fc-b1db-43d1-9645-163db470fdfc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:41 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-332258fc-b1db-43d1-9645-163db470fdfc Nov 06 10:42:41 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:42 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-332258fc-b1db-43d1-9645-163db470fdfc" returned: 0 in 0.392s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:42:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:42:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c251c5c3-6e54-4748-b5fb-7aa7a0c8b564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-332258fc-b1db-43d1-9645-163db470fdfc', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9e3063-0c24-494f-9de1-d135c4215a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:42 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Volume volume-332258fc-b1db-43d1-9645-163db470fdfc (332258fc-b1db-43d1-9645-163db470fdfc): created successfully Nov 06 10:42:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9e3063-0c24-494f-9de1-d135c4215a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Flow 'volume_create_manager' (23c4ebce-8041-4ed9-a177-aa1a44fe62c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:42:42 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5ef3b26b-e78b-4b01-933f-b73e7ac0ebf9 tempest-AttachVolumeShelveTestJSON-680226612 None] Created volume successfully. Nov 06 10:42:48 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c3495e10-c35b-4cb4-a580-cdc34e57ddef tempest-GroupSnapshotsV319Test-161417857 None] Group tempest-GroupSnapshotsV319Test-Group-1373319752: creating Nov 06 10:42:48 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c3495e10-c35b-4cb4-a580-cdc34e57ddef tempest-GroupSnapshotsV319Test-161417857 None] Group tempest-GroupSnapshotsV319Test-Group-1373319752: created successfully Nov 06 10:42:48 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c3495e10-c35b-4cb4-a580-cdc34e57ddef tempest-GroupSnapshotsV319Test-161417857 None] Create group completed successfully. Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Flow 'volume_create_manager' (ebbc6435-0b12-494b-a2f2-aec685ae7b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778e3682-bdec-4aff-8e40-cd6844731ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778e3682-bdec-4aff-8e40-cd6844731ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-279682192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=de9e8c0e-71fe-44c6-981a-2c264b02fb22,host='devstack@QuobyteHD#QuobyteHD',id=71197b2b-7abd-4d04-b1d8-72a1b9b8a34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be91462e18f4bd88fbe9154a936ef29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:42:50Z,use_quota=True,user_id='c4ba0f04ebd249429154fd4a964532ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f24c199-6305-490a-af16-5e76e5cf4ae0),volume_type_id=5f24c199-6305-490a-af16-5e76e5cf4ae0)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a8fa9b-9dd4-4f73-a9db-6706c8138d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a8fa9b-9dd4-4f73-a9db-6706c8138d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76437fd8-a4cd-454d-b5bf-2e41433414a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76437fd8-a4cd-454d-b5bf-2e41433414a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71197b2b-7abd-4d04-b1d8-72a1b9b8a34f', 'volume_name': 'volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1737d584-bd35-45d7-adc9-6c36d490762b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1737d584-bd35-45d7-adc9-6c36d490762b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1ac571-9e48-4ab5-b030-15e878d30dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:50 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Volume 71197b2b-7abd-4d04-b1d8-72a1b9b8a34f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f', 'volume_size': 1} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=de9e8c0e-71fe-44c6-981a-2c264b02fb22,created_at=2026-11-06T09:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-279682192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=de9e8c0e-71fe-44c6-981a-2c264b02fb22,host='devstack@QuobyteHD#QuobyteHD',id=71197b2b-7abd-4d04-b1d8-72a1b9b8a34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be91462e18f4bd88fbe9154a936ef29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:42:50Z,use_quota=True,user_id='c4ba0f04ebd249429154fd4a964532ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f24c199-6305-490a-af16-5e76e5cf4ae0),volume_type_id=5f24c199-6305-490a-af16-5e76e5cf4ae0)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Creating volume 71197b2b-7abd-4d04-b1d8-72a1b9b8a34f {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:42:50 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:42:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:50 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f 1073741824 Nov 06 10:42:50 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:51 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f 1073741824" returned: 0 in 0.494s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:51 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f Nov 06 10:42:51 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:51 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f" returned: 0 in 0.351s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:42:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:42:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1ac571-9e48-4ab5-b030-15e878d30dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c4e34d-94de-4bab-9a39-c6ceb628dce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:42:51 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Volume volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f (71197b2b-7abd-4d04-b1d8-72a1b9b8a34f): created successfully Nov 06 10:42:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c4e34d-94de-4bab-9a39-c6ceb628dce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:42:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Flow 'volume_create_manager' (ebbc6435-0b12-494b-a2f2-aec685ae7b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:42:51 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-cdf5a150-5fca-44fc-aafd-e96afb4e47c3 tempest-GroupSnapshotsV319Test-161417857 None] Created volume successfully. Nov 06 10:42:52 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] GroupSnapshot de4d0d98-9e36-4c85-b8ba-63e664ace9ba: creating. Nov 06 10:42:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] Group snapshot de4d0d98-9e36-4c85-b8ba-63e664ace9ba: creating. {{(pid=86819) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 10:42:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:42:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:42:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] Creating offline snapshot 99293eef-c3ec-4477-b6de-ff21f0d036be of volume 71197b2b-7abd-4d04-b1d8-72a1b9b8a34f {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:42:52 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[60370cda-424c-4f83-965a-35d0df64807d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:42:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:52 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f Nov 06 10:42:52 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:52 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f" returned: 0 in 0.463s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:52 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be 1G Nov 06 10:42:52 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:53 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be 1G" returned: 0 in 0.417s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:53 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be Nov 06 10:42:53 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:53 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be" returned: 0 in 0.293s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:53 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be is being set with open permissions: ugo+rw: NotImplementedError Nov 06 10:42:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:53 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be Nov 06 10:42:53 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:53 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be" returned: 0 in 0.245s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:53 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.info Nov 06 10:42:53 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:54 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.info" returned: 0 in 0.310s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:54 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 10:42:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:54 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.info Nov 06 10:42:54 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:54 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.info" returned: 0 in 0.261s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.121s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:42:54 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-47bdd69f-49bb-45c8-ab61-89ad9b32f054 tempest-GroupSnapshotsV319Test-161417857 None] group_snapshot de4d0d98-9e36-4c85-b8ba-63e664ace9ba: created successfully Nov 06 10:42:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-20cdb8e8-bb0e-462e-b220-6f3ef6a6c898 req-85fad8d7-1441-41cf-b057-f9e0ed4670e2 tempest-AttachVolumeShelveTestJSON-680226612 None] No connector for attachment 542e5cce-e806-4e37-9063-8fc283f16ad5; skipping storage backend terminate_connection call. {{(pid=86819) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5009}} Nov 06 10:42:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-20cdb8e8-bb0e-462e-b220-6f3ef6a6c898 req-85fad8d7-1441-41cf-b057-f9e0ed4670e2 tempest-AttachVolumeShelveTestJSON-680226612 None] Deleting attachment 542e5cce-e806-4e37-9063-8fc283f16ad5. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:42:55 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] group_snapshot de4d0d98-9e36-4c85-b8ba-63e664ace9ba: deleting Nov 06 10:42:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] group_snapshot de4d0d98-9e36-4c85-b8ba-63e664ace9ba: deleting {{(pid=86819) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 10:42:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] Acquiring lock "cinder-quobyte-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:42:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] Lock "cinder-quobyte-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:42:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] Acquiring lock "cinder-quobyte-99293eef-c3ec-4477-b6de-ff21f0d036be" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:42:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] Lock "cinder-quobyte-99293eef-c3ec-4477-b6de-ff21f0d036be" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:42:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] Deleting offline snapshot 99293eef-c3ec-4477-b6de-ff21f0d036be of volume 71197b2b-7abd-4d04-b1d8-72a1b9b8a34f {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:42:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] snapshot_file for this snap is: volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:42:56 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aba5f8d-bd0a-4389-920c-1d15774a130d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:42:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:56 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be Nov 06 10:42:56 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:56 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be" returned: 0 in 0.470s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:42:56 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f20a27-dc79-4d57-85bf-225a12eedcdd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:42:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:56 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f Nov 06 10:42:56 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:57 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f" returned: 0 in 0.494s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:57 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be Nov 06 10:42:57 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:57 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be" returned: 0 in 0.384s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:57 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be Nov 06 10:42:57 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:57 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f.99293eef-c3ec-4477-b6de-ff21f0d036be" returned: 0 in 0.277s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:57 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] Lock "cinder-quobyte-99293eef-c3ec-4477-b6de-ff21f0d036be" released by "_delete_snapshot" :: held 1.758s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:42:57 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] Lock "cinder-quobyte-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f" released by "delete_snapshot" :: held 1.783s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:42:57 devstack cinder-volume[86819]: WARNING cinder.quota [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1175628864 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1175628864, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:42:57 devstack cinder-volume[86819]: WARNING cinder.quota [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1175628864 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1175628864, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:42:57 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] Created reservations ['13bd5049-cb00-4deb-8a95-fca9b50708ea', '552999be-b4c2-456d-b611-d704f88fd4dc', '306bb771-a0ad-4261-85fd-e7bd1245c446', 'a3fb3413-b4c7-420f-ad88-5872a90ba097'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:42:57 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-dca3f2d1-13d6-4b24-9c33-72b03b840e64 tempest-GroupSnapshotsV319Test-161417857 None] group_snapshot de4d0d98-9e36-4c85-b8ba-63e664ace9ba: deleted successfully Nov 06 10:42:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Acquiring lock "cinder-quobyte-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:42:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Lock "cinder-quobyte-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:42:58 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1c67f2-d634-4c5c-9b9f-876800ba31ba]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:42:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:58 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f Nov 06 10:42:58 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:59 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f" returned: 0 in 0.410s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:59 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f Nov 06 10:42:59 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:42:59 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Nov 06 10:42:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f" returned: 0 in 0.342s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:42:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Lock "cinder-quobyte-71197b2b-7abd-4d04-b1d8-72a1b9b8a34f" released by "delete_volume" :: held 0.837s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:42:59 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Created reservations ['96e5ae6a-7c99-4dbb-8f3b-1af50e4641f9'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:42:59 devstack cinder-volume[86819]: WARNING cinder.quota [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1175628864 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1175628864, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:42:59 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Created reservations ['0cafb351-b487-45b2-9ada-0a48cb63752f', 'ef5ba0e5-558b-4209-ba32-1c28fa96cab8', '0193d1bc-4b87-4371-8af6-82abf4e03d71', '1a19e1c9-6072-4023-9d7e-0eb128373f4d'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:42:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:42:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:42:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:42:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:42:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:42:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:42:59 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:42:59 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:00 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.396s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:00 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:43:00 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5164905f-2c18-473a-acaf-df8464958964 tempest-GroupSnapshotsV319Test-161417857 None] Delete group completed successfully. Nov 06 10:43:09 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-04e1be1b-2e55-4baf-8d9f-6dd722fed9f1 tempest-GroupsV314Test-1700685772 None] Group tempest-GroupsV314Test-Group-695101380: creating Nov 06 10:43:09 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-04e1be1b-2e55-4baf-8d9f-6dd722fed9f1 tempest-GroupsV314Test-1700685772 None] Group tempest-GroupsV314Test-Group-695101380: created successfully Nov 06 10:43:09 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-04e1be1b-2e55-4baf-8d9f-6dd722fed9f1 tempest-GroupsV314Test-1700685772 None] Create group completed successfully. Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Flow 'volume_create_manager' (ed75ecd2-a32f-41d8-8c12-13e39d2a8968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497f3c2c-8e5e-4435-9b3e-742b64daedb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497f3c2c-8e5e-4435-9b3e-742b64daedb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959700660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fecb8316-d61e-479b-8b3b-d327c01b2f59,host='devstack@QuobyteHD#QuobyteHD',id=db497f18-ca94-4e6d-86a2-761a5591bf84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02734d40242c4fffa347d5efef135ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:43:11Z,use_quota=True,user_id='3e4bfe4182ae4c1aa109b99eca3fd147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88bf7f13-1d47-478b-a42e-cbcb6ed098df),volume_type_id=88bf7f13-1d47-478b-a42e-cbcb6ed098df)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3540880e-3838-41c9-86a1-b046cfd22d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3540880e-3838-41c9-86a1-b046cfd22d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b752bcb-1dd3-4043-b5ab-72dae49d7c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b752bcb-1dd3-4043-b5ab-72dae49d7c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db497f18-ca94-4e6d-86a2-761a5591bf84', 'volume_name': 'volume-db497f18-ca94-4e6d-86a2-761a5591bf84', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e559f9b-498c-498f-9de4-7a3bbba19573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e559f9b-498c-498f-9de4-7a3bbba19573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c327d835-55e8-4c33-8a97-407a741ffb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:10 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Volume db497f18-ca94-4e6d-86a2-761a5591bf84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db497f18-ca94-4e6d-86a2-761a5591bf84', 'volume_size': 1} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fecb8316-d61e-479b-8b3b-d327c01b2f59,created_at=2026-11-06T09:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959700660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fecb8316-d61e-479b-8b3b-d327c01b2f59,host='devstack@QuobyteHD#QuobyteHD',id=db497f18-ca94-4e6d-86a2-761a5591bf84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02734d40242c4fffa347d5efef135ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:43:11Z,use_quota=True,user_id='3e4bfe4182ae4c1aa109b99eca3fd147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88bf7f13-1d47-478b-a42e-cbcb6ed098df),volume_type_id=88bf7f13-1d47-478b-a42e-cbcb6ed098df)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Creating volume db497f18-ca94-4e6d-86a2-761a5591bf84 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:10 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:43:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:43:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:43:11 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:43:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:11 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 1073741824 Nov 06 10:43:11 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:11 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 1073741824" returned: 0 in 0.595s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:11 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 Nov 06 10:43:11 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:11 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84" returned: 0 in 0.333s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:43:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c327d835-55e8-4c33-8a97-407a741ffb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db497f18-ca94-4e6d-86a2-761a5591bf84', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1f224f-2c0a-46bb-9e2f-b43686b46121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:12 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Volume volume-db497f18-ca94-4e6d-86a2-761a5591bf84 (db497f18-ca94-4e6d-86a2-761a5591bf84): created successfully Nov 06 10:43:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1f224f-2c0a-46bb-9e2f-b43686b46121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Flow 'volume_create_manager' (ed75ecd2-a32f-41d8-8c12-13e39d2a8968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:43:12 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d899ccb8-aaf1-4be8-b359-0d0624787d01 tempest-GroupsV314Test-1700685772 None] Created volume successfully. Nov 06 10:43:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:13 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Cloning volume db497f18-ca94-4e6d-86a2-761a5591bf84 to volume 900b14c9-8729-416e-a2bf-c0ae0b23a69d Nov 06 10:43:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Creating offline snapshot 950830b1-4f06-48c8-9e25-1490ec35d710 of volume db497f18-ca94-4e6d-86a2-761a5591bf84 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:43:13 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c44962-fb5f-4657-b55a-71b060756dab]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:43:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:13 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 Nov 06 10:43:13 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:13 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84" returned: 0 in 0.621s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:13 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 1G Nov 06 10:43:13 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:14 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 1G" returned: 0 in 0.485s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db497f18-ca94-4e6d-86a2-761a5591bf84 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:14 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db497f18-ca94-4e6d-86a2-761a5591bf84 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 Nov 06 10:43:14 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:15 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db497f18-ca94-4e6d-86a2-761a5591bf84 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710" returned: 0 in 0.876s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:15 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 10:43:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:15 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 Nov 06 10:43:15 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:15 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710" returned: 0 in 0.547s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:15 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.info Nov 06 10:43:15 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:16 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.info" returned: 0 in 0.393s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:16 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 10:43:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:16 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.info Nov 06 10:43:16 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:16 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.info" returned: 0 in 0.508s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Acquiring lock "cinder-quobyte-900b14c9-8729-416e-a2bf-c0ae0b23a69d" by "_copy_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:43:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Lock "cinder-quobyte-900b14c9-8729-416e-a2bf-c0ae0b23a69d" acquired by "_copy_volume_from_snapshot" :: waited 0.057s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:43:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] snapshot: 950830b1-4f06-48c8-9e25-1490ec35d710, volume: 900b14c9-8729-416e-a2bf-c0ae0b23a69d, {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 10:43:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:43:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:43:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:16 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d144bf-6927-4f9b-a9b0-5340348b86b6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:43:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:17 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 Nov 06 10:43:17 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:17 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710" returned: 0 in 0.481s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db497f18-ca94-4e6d-86a2-761a5591bf84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:43:17 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[30271163-5927-4666-95b9-74f1f028b318]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:43:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:17 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 Nov 06 10:43:17 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:18 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84" returned: 0 in 0.598s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] will copy from snapshot at /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 10:43:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Creating direct copy from snapshot {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 10:43:18 devstack cinder-volume[86819]: DEBUG cinder.utils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Path /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-900b14c9-8729-416e-a2bf-c0ae0b23a69d not found in is_blk_device check {{(pid=86819) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 10:43:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-900b14c9-8729-416e-a2bf-c0ae0b23a69d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:18 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-900b14c9-8729-416e-a2bf-c0ae0b23a69d Nov 06 10:43:18 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:23 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=76,cinder:UPDATE=40,cinder:INSERT=15,cinder:DELETE=6 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:43:23 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=63,cinder:SELECT=61,cinder:INSERT=10 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:43:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-0226a2ae-37be-4304-966a-f5b97cc1925a req-fbfaf828-e26e-46c6-b5f9-50a8c9253153 tempest-ServerActionsTestOtherA-1183418255 None] Terminate volume connection completed successfully. Nov 06 10:43:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0226a2ae-37be-4304-966a-f5b97cc1925a req-fbfaf828-e26e-46c6-b5f9-50a8c9253153 tempest-ServerActionsTestOtherA-1183418255 None] Deleting attachment c5ef6e4a-ad75-45c1-8861-dc007cca603a. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:43:29 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-900b14c9-8729-416e-a2bf-c0ae0b23a69d" returned: 0 in 11.460s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:29 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Image conversion details: src /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84, size 1024.00 MB, duration 11.46 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-900b14c9-8729-416e-a2bf-c0ae0b23a69d {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:43:29 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Converted 1024.00 MB image at 89.34 MB/s Nov 06 10:43:29 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-900b14c9-8729-416e-a2bf-c0ae0b23a69d is being set with open permissions: ugo+rw: NotImplementedError Nov 06 10:43:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-900b14c9-8729-416e-a2bf-c0ae0b23a69d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:29 devstack sudo[93332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-900b14c9-8729-416e-a2bf-c0ae0b23a69d Nov 06 10:43:29 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:29 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-900b14c9-8729-416e-a2bf-c0ae0b23a69d" returned: 0 in 0.374s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Lock "cinder-quobyte-900b14c9-8729-416e-a2bf-c0ae0b23a69d" released by "_copy_volume_from_snapshot" :: held 13.066s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:43:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Acquiring lock "cinder-quobyte-950830b1-4f06-48c8-9e25-1490ec35d710" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:43:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Lock "cinder-quobyte-950830b1-4f06-48c8-9e25-1490ec35d710" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:43:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Deleting offline snapshot 950830b1-4f06-48c8-9e25-1490ec35d710 of volume db497f18-ca94-4e6d-86a2-761a5591bf84 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:43:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] snapshot_file for this snap is: volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:43:30 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f90ba81-1870-4e4e-bfc4-e9ecf856ba5f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:43:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:30 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 Nov 06 10:43:30 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:30 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710" returned: 0 in 0.420s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db497f18-ca94-4e6d-86a2-761a5591bf84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:43:30 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b55e540-15cd-4701-b227-604c490784e1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:43:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:30 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 Nov 06 10:43:30 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:31 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84" returned: 0 in 0.579s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:31 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 Nov 06 10:43:31 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:31 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710" returned: 0 in 0.360s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:31 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710 Nov 06 10:43:31 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:31 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84.950830b1-4f06-48c8-9e25-1490ec35d710" returned: 0 in 0.293s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Lock "cinder-quobyte-950830b1-4f06-48c8-9e25-1490ec35d710" released by "_delete_snapshot" :: held 1.794s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:43:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.713s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:31 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-17eb983b-fda3-4676-9710-c655caf49d5f tempest-GroupsV314Test-1700685772 None] Create group from source-group-fecb8316-d61e-479b-8b3b-d327c01b2f59 completed successfully. Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Acquiring lock "cinder-quobyte-900b14c9-8729-416e-a2bf-c0ae0b23a69d" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Lock "cinder-quobyte-900b14c9-8729-416e-a2bf-c0ae0b23a69d" acquired by "delete_volume" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4e78ba-dad1-40a3-b9e7-8d7c5dea2e80]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-900b14c9-8729-416e-a2bf-c0ae0b23a69d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Flow 'volume_create_manager' (f289c2a7-5094-4288-bb3d-6af5a4fd5347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40388a99-6f16-4717-be4e-62c8187eb3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40388a99-6f16-4717-be4e-62c8187eb3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1559504609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96309ac2-77a4-41c0-83da-6efef3e3b7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27898add2c84a8f9b87ba04ff576445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:43:33Z,use_quota=True,user_id='b6388a8b9537492ca575582ec6c64462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:33 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-900b14c9-8729-416e-a2bf-c0ae0b23a69d Nov 06 10:43:33 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fc2191-e5b2-4237-889a-454f4aa11aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fc2191-e5b2-4237-889a-454f4aa11aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4125b6dc-a67e-4b64-b712-52b5b14d09c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.image.glance [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Creating Keystone auth plugin from conf {{(pid=86819) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 10:43:33 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-900b14c9-8729-416e-a2bf-c0ae0b23a69d" returned: 0 in 0.386s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-900b14c9-8729-416e-a2bf-c0ae0b23a69d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:33 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-900b14c9-8729-416e-a2bf-c0ae0b23a69d Nov 06 10:43:33 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4125b6dc-a67e-4b64-b712-52b5b14d09c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '96309ac2-77a4-41c0-83da-6efef3e3b7a4', 'volume_name': 'volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4', 'volume_size': 1, 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a31bb778f245ada373212e6fd01b04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'created_at': datetime.datetime(2026, 11, 6, 9, 33, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3141da4f-e70d-439b-81af-e22387bd01d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4441854-8c36-408b-9d42-f769992f21cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4441854-8c36-408b-9d42-f769992f21cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec79dd3e-3cee-472d-b758-b69698b269a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:33 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Volume 96309ac2-77a4-41c0-83da-6efef3e3b7a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4', 'volume_size': 1, 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a31bb778f245ada373212e6fd01b04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'created_at': datetime.datetime(2026, 11, 6, 9, 33, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3141da4f-e70d-439b-81af-e22387bd01d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Trying to clone 96309ac2-77a4-41c0-83da-6efef3e3b7a4 from image 3141da4f-e70d-439b-81af-e22387bd01d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]). {{(pid=86819) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 10:43:33 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-900b14c9-8729-416e-a2bf-c0ae0b23a69d" returned: 0 in 0.267s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Lock "cinder-quobyte-900b14c9-8729-416e-a2bf-c0ae0b23a69d" released by "delete_volume" :: held 0.723s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Created reservations ['18f22973-1039-4d1f-a80c-3a3b0b20a92d'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_vcl6vasedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 10:43:34 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Image download 20.69 MB at 20.69 MB/s Nov 06 10:43:34 devstack cinder-volume[86819]: WARNING cinder.quota [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-211528167 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-211528167, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:43:34 devstack cinder-volume[86819]: WARNING cinder.quota [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-211528167 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-211528167, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaf36bf-fc6d-4702-ad6e-f14e6ecaa132]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_vcl6vasedevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Created reservations ['f533b2ef-ae17-47c1-ae28-0b95f9dceb14', 'bba49c01-091e-49ee-af8d-da8dce724451', '2aab2ef6-f7d6-4891-9ec2-3d8c83cf8035', '747a7a59-ff82-47d5-932e-740f55a3d44b'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:34 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_vcl6vasedevstack@QuobyteHD Nov 06 10:43:34 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:34 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:43:34 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:34 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_vcl6vasedevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Temporary image 3141da4f-e70d-439b-81af-e22387bd01d4 is fetched for user b6388a8b9537492ca575582ec6c64462. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 10:43:34 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.276s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:43:34 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b5abd07d-fb0a-47e2-93c7-8fa53788a25c tempest-GroupsV314Test-1700685772 None] Delete group completed successfully. Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0f206a-129f-44b4-b191-b1e90148f03d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_vcl6vasedevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] Acquiring lock "cinder-quobyte-db497f18-ca94-4e6d-86a2-761a5591bf84" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] Lock "cinder-quobyte-db497f18-ca94-4e6d-86a2-761a5591bf84" acquired by "delete_volume" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:43:34 devstack sudo[93416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_vcl6vasedevstack@QuobyteHD Nov 06 10:43:34 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e12b78c-d96f-40dd-b8d9-4f876301fd7f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:34 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 Nov 06 10:43:34 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:34 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_vcl6vasedevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1559504609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96309ac2-77a4-41c0-83da-6efef3e3b7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27898add2c84a8f9b87ba04ff576445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:43:33Z,use_quota=True,user_id='b6388a8b9537492ca575582ec6c64462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Creating volume 96309ac2-77a4-41c0-83da-6efef3e3b7a4 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:43:34 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:43:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:34 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 1073741824 Nov 06 10:43:34 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:35 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84" returned: 0 in 0.361s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:35 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84 Nov 06 10:43:35 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:35 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 1073741824" returned: 0 in 0.421s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:35 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-db497f18-ca94-4e6d-86a2-761a5591bf84" returned: 0 in 0.268s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] Lock "cinder-quobyte-db497f18-ca94-4e6d-86a2-761a5591bf84" released by "delete_volume" :: held 0.703s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:35 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 Nov 06 10:43:35 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] Created reservations ['0f356307-890e-47e9-9597-2a4f462777d5'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] Created reservations ['66322b56-55ef-49d2-9928-eb52dff0b89c', '21ac0c55-7651-4ede-98f5-4cba32766e93', 'bf444f53-e521-4199-905a-68e6f6ffa32c', '4357ce2d-914a-4886-80a2-c4d5d52a02ea'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:35 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:43:35 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:35 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4" returned: 0 in 0.262s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Attempting download of 3141da4f-e70d-439b-81af-e22387bd01d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}])) to volume 96309ac2-77a4-41c0-83da-6efef3e3b7a4. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdd4ea1-f4b3-43fa-9cb4-7533acb7d28d]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_pcodxh35 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:35 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_pcodxh35 Nov 06 10:43:35 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:35 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.282s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:35 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:43:35 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-f15a5936-379d-4680-a595-544a7fdf1a3c tempest-GroupsV314Test-1700685772 None] Delete group completed successfully. Nov 06 10:43:36 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_pcodxh35" returned: 0 in 0.354s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_pcodxh35 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:36 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:43:36 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:36 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_pcodxh35 Nov 06 10:43:36 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:36 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.276s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 28 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:43:36 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_pcodxh35" returned: 1 in 0.344s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_pcodxh35' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fbd6df-b75b-4fe9-ade7-10d5ba254fee]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_vcl6vasedevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:36 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_vcl6vasedevstack@QuobyteHD Nov 06 10:43:36 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:36 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_vcl6vasedevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] 3141da4f-e70d-439b-81af-e22387bd01d4 was qcow2, converting to qcow2 {{(pid=86819) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 10:43:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_vcl6vasedevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:36 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_vcl6vasedevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 Nov 06 10:43:36 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:39 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_vcl6vasedevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4" returned: 0 in 2.303s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:39 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_vcl6vasedevstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:43:39 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Converted 112.00 MB image at 48.60 MB/s Nov 06 10:43:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:39 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 1G Nov 06 10:43:39 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:39 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 1G" returned: 0 in 0.339s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:39 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Downloaded image 3141da4f-e70d-439b-81af-e22387bd01d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}])) to volume 96309ac2-77a4-41c0-83da-6efef3e3b7a4 successfully. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 10:43:39 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Temporary image 3141da4f-e70d-439b-81af-e22387bd01d4 for user b6388a8b9537492ca575582ec6c64462 is deleted. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 10:43:39 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Marking volume 96309ac2-77a4-41c0-83da-6efef3e3b7a4 as bootable. {{(pid=86819) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 10:43:39 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Copying metadata from image 3141da4f-e70d-439b-81af-e22387bd01d4 to 96309ac2-77a4-41c0-83da-6efef3e3b7a4. {{(pid=86819) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 10:43:39 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Creating volume glance metadata for volume 96309ac2-77a4-41c0-83da-6efef3e3b7a4 backed by image 3141da4f-e70d-439b-81af-e22387bd01d4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86819) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 10:43:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec79dd3e-3cee-472d-b758-b69698b269a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4', 'volume_size': 1, 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a31bb778f245ada373212e6fd01b04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'created_at': datetime.datetime(2026, 11, 6, 9, 33, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3141da4f-e70d-439b-81af-e22387bd01d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0a0781-da71-4859-9bf5-e81849e7c05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:39 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Volume volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 (96309ac2-77a4-41c0-83da-6efef3e3b7a4): created successfully Nov 06 10:43:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0a0781-da71-4859-9bf5-e81849e7c05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Flow 'volume_create_manager' (f289c2a7-5094-4288-bb3d-6af5a4fd5347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:43:39 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-fe5624c4-4d9b-4534-be71-0ce100f65a09 tempest-ServerActionsTestOtherA-1183418255 None] Created volume successfully. Nov 06 10:43:41 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:43:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Flow 'volume_create_manager' (6fffc4ef-9a26-418e-a032-7a94c311bee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:43:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4977e051-24f2-4eab-b20c-bdc0633d858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4977e051-24f2-4eab-b20c-bdc0633d858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1124405321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3779f51-8b43-48b4-a4e2-344ff952cbbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f8ec7a55aba45dbb20dc496ac8d4188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:43:42Z,use_quota=True,user_id='9ad77a30e87f408cb447022631eb827f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad61296c-44f3-4f6c-bf40-bf57fda9246e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad61296c-44f3-4f6c-bf40-bf57fda9246e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5cb79d-c732-4f0c-bd0e-1bfed89bd580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5cb79d-c732-4f0c-bd0e-1bfed89bd580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3779f51-8b43-48b4-a4e2-344ff952cbbc', 'volume_name': 'volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104ca9db-c269-4468-9afb-a08beb931947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104ca9db-c269-4468-9afb-a08beb931947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2790f6e6-f3b5-44ed-a1ed-2983ce7a5375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:42 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Volume c3779f51-8b43-48b4-a4e2-344ff952cbbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc', 'volume_size': 1} Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1124405321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3779f51-8b43-48b4-a4e2-344ff952cbbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f8ec7a55aba45dbb20dc496ac8d4188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:43:42Z,use_quota=True,user_id='9ad77a30e87f408cb447022631eb827f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Creating volume c3779f51-8b43-48b4-a4e2-344ff952cbbc {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:43:42 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:42 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc 1073741824 Nov 06 10:43:42 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:42 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc 1073741824" returned: 0 in 0.564s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:42 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc Nov 06 10:43:42 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:42 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc" returned: 0 in 0.354s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:43:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2790f6e6-f3b5-44ed-a1ed-2983ce7a5375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aac86d1-43eb-4c08-a44b-9e2b2347c05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:43 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Volume volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc (c3779f51-8b43-48b4-a4e2-344ff952cbbc): created successfully Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aac86d1-43eb-4c08-a44b-9e2b2347c05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Flow 'volume_create_manager' (6fffc4ef-9a26-418e-a032-7a94c311bee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:43:43 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-89c55a8f-ccb5-4e68-9bbd-84b6b68230b7 tempest-AttachVolumeTestJSON-723569238 None] Created volume successfully. Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Flow 'volume_create_manager' (8437a121-e8d0-4388-9e60-ac61a166b1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d67c59a-555f-41ea-b00a-06f8009e1fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d67c59a-555f-41ea-b00a-06f8009e1fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-918111009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceae3afc-9363-49e1-8afc-d1b53932a50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504d6cd73bef40559ae9d2b321121866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:43:43Z,use_quota=True,user_id='f24e6b3e644a4812873b8cd18d1e7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3346935-bf3d-47cc-b4b3-601f325039af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3346935-bf3d-47cc-b4b3-601f325039af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9f9278-a3b4-4c89-b42d-3b4bab3a15ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9f9278-a3b4-4c89-b42d-3b4bab3a15ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceae3afc-9363-49e1-8afc-d1b53932a50e', 'volume_name': 'volume-ceae3afc-9363-49e1-8afc-d1b53932a50e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4706b0cb-b845-4a55-b6e0-6dc5f126ae2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4706b0cb-b845-4a55-b6e0-6dc5f126ae2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4cbc18-d3dc-4576-a5ec-5dab67e1ed18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:43 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Volume ceae3afc-9363-49e1-8afc-d1b53932a50e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceae3afc-9363-49e1-8afc-d1b53932a50e', 'volume_size': 1} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-918111009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceae3afc-9363-49e1-8afc-d1b53932a50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504d6cd73bef40559ae9d2b321121866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:43:43Z,use_quota=True,user_id='f24e6b3e644a4812873b8cd18d1e7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Creating volume ceae3afc-9363-49e1-8afc-d1b53932a50e {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:43:43 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:43:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ceae3afc-9363-49e1-8afc-d1b53932a50e 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:43 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ceae3afc-9363-49e1-8afc-d1b53932a50e 1073741824 Nov 06 10:43:43 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:43 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ceae3afc-9363-49e1-8afc-d1b53932a50e 1073741824" returned: 0 in 0.534s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ceae3afc-9363-49e1-8afc-d1b53932a50e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:44 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ceae3afc-9363-49e1-8afc-d1b53932a50e Nov 06 10:43:44 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:44 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ceae3afc-9363-49e1-8afc-d1b53932a50e" returned: 0 in 0.334s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:43:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4cbc18-d3dc-4576-a5ec-5dab67e1ed18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceae3afc-9363-49e1-8afc-d1b53932a50e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd578e1b-5fff-4546-9144-7733bdcf0d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:44 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Volume volume-ceae3afc-9363-49e1-8afc-d1b53932a50e (ceae3afc-9363-49e1-8afc-d1b53932a50e): created successfully Nov 06 10:43:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd578e1b-5fff-4546-9144-7733bdcf0d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Flow 'volume_create_manager' (8437a121-e8d0-4388-9e60-ac61a166b1c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:43:44 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-3f1a6446-c0f7-4c91-b2a7-7c7708bd4738 tempest-VolumeQuotasAdminTestJSON-969001121 None] Created volume successfully. Nov 06 10:43:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-bbf81000-1704-486c-9f29-95d52dbfaf78 req-6cacc454-5d8e-4dfa-908d-08cdd9d8734f tempest-ServerActionsTestOtherA-1183418255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-bbf81000-1704-486c-9f29-95d52dbfaf78 req-6cacc454-5d8e-4dfa-908d-08cdd9d8734f tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-bbf81000-1704-486c-9f29-95d52dbfaf78 req-6cacc454-5d8e-4dfa-908d-08cdd9d8734f tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-bbf81000-1704-486c-9f29-95d52dbfaf78 req-6cacc454-5d8e-4dfa-908d-08cdd9d8734f tempest-ServerActionsTestOtherA-1183418255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb2583a3-2898-446c-97d3-52df99a34dc5', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:43:44 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-bbf81000-1704-486c-9f29-95d52dbfaf78 req-6cacc454-5d8e-4dfa-908d-08cdd9d8734f tempest-ServerActionsTestOtherA-1183418255 None] attachment_update completed successfully. Nov 06 10:43:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-eea039cd-59ca-4273-b55f-8cdfb810e793 req-f9706fc9-95d5-4ba9-9668-3ce85c747229 tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-eea039cd-59ca-4273-b55f-8cdfb810e793 req-f9706fc9-95d5-4ba9-9668-3ce85c747229 tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-eea039cd-59ca-4273-b55f-8cdfb810e793 req-f9706fc9-95d5-4ba9-9668-3ce85c747229 tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-eea039cd-59ca-4273-b55f-8cdfb810e793 req-f9706fc9-95d5-4ba9-9668-3ce85c747229 tempest-AttachVolumeTestJSON-723569238 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '000bbbfa-4311-43aa-9834-d8ade781b136', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:43:45 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-eea039cd-59ca-4273-b55f-8cdfb810e793 req-f9706fc9-95d5-4ba9-9668-3ce85c747229 tempest-AttachVolumeTestJSON-723569238 None] attachment_update completed successfully. Nov 06 10:43:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Acquiring lock "cinder-ceae3afc-9363-49e1-8afc-d1b53932a50e-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:43:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Lock "cinder-ceae3afc-9363-49e1-8afc-d1b53932a50e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:43:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Acquiring lock "cinder-quobyte-ceae3afc-9363-49e1-8afc-d1b53932a50e" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:43:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Lock "cinder-quobyte-ceae3afc-9363-49e1-8afc-d1b53932a50e" acquired by "delete_volume" :: waited 0.033s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:43:45 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61afc68-48ed-4033-888c-2d1900b2c001]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:43:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ceae3afc-9363-49e1-8afc-d1b53932a50e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:46 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ceae3afc-9363-49e1-8afc-d1b53932a50e Nov 06 10:43:46 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:46 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ceae3afc-9363-49e1-8afc-d1b53932a50e" returned: 0 in 0.636s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ceae3afc-9363-49e1-8afc-d1b53932a50e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:46 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ceae3afc-9363-49e1-8afc-d1b53932a50e Nov 06 10:43:46 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:46 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ceae3afc-9363-49e1-8afc-d1b53932a50e" returned: 0 in 0.479s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Lock "cinder-quobyte-ceae3afc-9363-49e1-8afc-d1b53932a50e" released by "delete_volume" :: held 1.202s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:43:47 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Created reservations ['84195411-d3c8-46b8-a440-3a69e8fa0561', '42648a73-ddc4-4063-801c-85a6715ae0a2', '24f400eb-2055-4911-9829-c040d5f76f28', '6b4eb5a2-f12e-45c6-9fc2-fef1facb7c57'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:43:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:43:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:43:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:47 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:43:47 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:47 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.366s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:47 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:43:47 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Deleted volume successfully. Nov 06 10:43:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4e2ccd08-6d14-4607-9ef3-1355c2c0ccb1 tempest-VolumeQuotasAdminTestJSON-969001121 None] Lock "cinder-ceae3afc-9363-49e1-8afc-d1b53932a50e-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:43:47 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:43:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Flow 'volume_create_manager' (3f40d31a-cc6c-474b-81e6-71f5f8922c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:43:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226d0f7c-3816-4447-acef-6f94dbff5ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226d0f7c-3816-4447-acef-6f94dbff5ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1391606984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2d5095-7b0a-45ca-a75b-a91b08011e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f8ec7a55aba45dbb20dc496ac8d4188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:43:48Z,use_quota=True,user_id='9ad77a30e87f408cb447022631eb827f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e811e620-ccae-47a1-8399-08f271b7cab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e811e620-ccae-47a1-8399-08f271b7cab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bd5e89-c42b-4f22-82ef-e5a7a3a0c112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bd5e89-c42b-4f22-82ef-e5a7a3a0c112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c2d5095-7b0a-45ca-a75b-a91b08011e6a', 'volume_name': 'volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f399789-0af7-40ac-9db2-21e7ce4631bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f399789-0af7-40ac-9db2-21e7ce4631bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7a17b0-43fa-4aca-8497-9c5125062de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:48 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Volume 0c2d5095-7b0a-45ca-a75b-a91b08011e6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a', 'volume_size': 1} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1391606984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2d5095-7b0a-45ca-a75b-a91b08011e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f8ec7a55aba45dbb20dc496ac8d4188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:43:48Z,use_quota=True,user_id='9ad77a30e87f408cb447022631eb827f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Creating volume 0c2d5095-7b0a-45ca-a75b-a91b08011e6a {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:43:48 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:48 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a 1073741824 Nov 06 10:43:48 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:48 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a 1073741824" returned: 0 in 0.621s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Flow 'volume_create_manager' (a2bb3483-5f51-4a7a-966e-eac30d337d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a0e6d4-8cc5-460e-8c8d-f1483b930bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:48 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a Nov 06 10:43:48 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a0e6d4-8cc5-460e-8c8d-f1483b930bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-671897833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df6b739-fa94-4962-b649-0143d4648bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504d6cd73bef40559ae9d2b321121866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:43:49Z,use_quota=True,user_id='f24e6b3e644a4812873b8cd18d1e7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe02f52-9830-4a22-ba7d-329b2f055d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe02f52-9830-4a22-ba7d-329b2f055d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f1ea27-b861-40a7-a2c0-eab3d5ccafcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f1ea27-b861-40a7-a2c0-eab3d5ccafcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df6b739-fa94-4962-b649-0143d4648bcf', 'volume_name': 'volume-4df6b739-fa94-4962-b649-0143d4648bcf', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd67839-38b5-407e-be5f-1dcca833449a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd67839-38b5-407e-be5f-1dcca833449a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdc2030-cbe9-4132-9d1d-6db36e695eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:48 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Volume 4df6b739-fa94-4962-b649-0143d4648bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df6b739-fa94-4962-b649-0143d4648bcf', 'volume_size': 1} Nov 06 10:43:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:49 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a" returned: 0 in 0.479s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.395s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-671897833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df6b739-fa94-4962-b649-0143d4648bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504d6cd73bef40559ae9d2b321121866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:43:49Z,use_quota=True,user_id='f24e6b3e644a4812873b8cd18d1e7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Creating volume 4df6b739-fa94-4962-b649-0143d4648bcf {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:43:49 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4df6b739-fa94-4962-b649-0143d4648bcf 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7a17b0-43fa-4aca-8497-9c5125062de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171c9f1b-1522-46b5-9fc5-43e369ce4f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:49 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Volume volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a (0c2d5095-7b0a-45ca-a75b-a91b08011e6a): created successfully Nov 06 10:43:49 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4df6b739-fa94-4962-b649-0143d4648bcf 1073741824 Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171c9f1b-1522-46b5-9fc5-43e369ce4f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:49 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Flow 'volume_create_manager' (3f40d31a-cc6c-474b-81e6-71f5f8922c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:43:49 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-47c93774-4bd1-4518-9f76-3d696f0653be tempest-AttachVolumeTestJSON-723569238 None] Created volume successfully. Nov 06 10:43:50 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4df6b739-fa94-4962-b649-0143d4648bcf 1073741824" returned: 0 in 0.875s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4df6b739-fa94-4962-b649-0143d4648bcf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:50 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4df6b739-fa94-4962-b649-0143d4648bcf Nov 06 10:43:50 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:50 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4df6b739-fa94-4962-b649-0143d4648bcf" returned: 0 in 0.459s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:43:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdc2030-cbe9-4132-9d1d-6db36e695eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df6b739-fa94-4962-b649-0143d4648bcf', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d157553-a842-4675-90ae-17be42b5ea10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:43:50 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Volume volume-4df6b739-fa94-4962-b649-0143d4648bcf (4df6b739-fa94-4962-b649-0143d4648bcf): created successfully Nov 06 10:43:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d157553-a842-4675-90ae-17be42b5ea10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:43:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Flow 'volume_create_manager' (a2bb3483-5f51-4a7a-966e-eac30d337d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:43:50 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-09fb0c0e-e3b7-4469-a5c3-400a885592d6 tempest-VolumeQuotasAdminTestJSON-969001121 None] Created volume successfully. Nov 06 10:43:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Acquiring lock "cinder-332258fc-b1db-43d1-9645-163db470fdfc-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:43:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Lock "cinder-332258fc-b1db-43d1-9645-163db470fdfc-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:43:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Acquiring lock "cinder-quobyte-332258fc-b1db-43d1-9645-163db470fdfc" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:43:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-bd482a11-1f54-4d1d-bd17-6dc59dd918d3 req-67e0a0b1-1948-4a9d-afce-c6c783bfcb7d tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-bd482a11-1f54-4d1d-bd17-6dc59dd918d3 req-67e0a0b1-1948-4a9d-afce-c6c783bfcb7d tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Lock "cinder-quobyte-332258fc-b1db-43d1-9645-163db470fdfc" acquired by "delete_volume" :: waited 0.064s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:43:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-bd482a11-1f54-4d1d-bd17-6dc59dd918d3 req-67e0a0b1-1948-4a9d-afce-c6c783bfcb7d tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.072s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:51 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab43b63-1428-4698-9453-0b33947c96c6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:43:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-332258fc-b1db-43d1-9645-163db470fdfc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-bd482a11-1f54-4d1d-bd17-6dc59dd918d3 req-67e0a0b1-1948-4a9d-afce-c6c783bfcb7d tempest-AttachVolumeTestJSON-723569238 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f27db758-eb31-4943-a192-2a2352062256', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:43:51 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-bd482a11-1f54-4d1d-bd17-6dc59dd918d3 req-67e0a0b1-1948-4a9d-afce-c6c783bfcb7d tempest-AttachVolumeTestJSON-723569238 None] attachment_update completed successfully. Nov 06 10:43:51 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-332258fc-b1db-43d1-9645-163db470fdfc Nov 06 10:43:51 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:52 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-332258fc-b1db-43d1-9645-163db470fdfc" returned: 0 in 0.586s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-332258fc-b1db-43d1-9645-163db470fdfc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:52 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-332258fc-b1db-43d1-9645-163db470fdfc Nov 06 10:43:52 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:52 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-332258fc-b1db-43d1-9645-163db470fdfc" returned: 0 in 0.468s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Lock "cinder-quobyte-332258fc-b1db-43d1-9645-163db470fdfc" released by "delete_volume" :: held 1.141s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:43:52 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Created reservations ['9a9821d1-ff37-416a-8b0e-fc8c0cc79931', 'b13a3e2b-a65c-4c19-8129-36f070693a20', '2cae364c-ee71-4ef9-8af6-3c0461598184', 'ae1965a3-fd76-4576-922c-a64b87d5e096'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:43:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:43:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:43:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:52 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:43:52 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:53 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-83a586d9-c758-4274-b3a7-84ab2a3e07fb tempest-VolumeQuotasAdminTestJSON-1358882685 None] Transfer volume completed successfully. Nov 06 10:43:53 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.469s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:53 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:43:53 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Deleted volume successfully. Nov 06 10:43:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0369a6c5-49af-44fd-8fb5-2f062a6f3696 tempest-AttachVolumeShelveTestJSON-680226612 None] Lock "cinder-332258fc-b1db-43d1-9645-163db470fdfc-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:43:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Acquiring lock "cinder-4df6b739-fa94-4962-b649-0143d4648bcf-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:43:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Lock "cinder-4df6b739-fa94-4962-b649-0143d4648bcf-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:43:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Acquiring lock "cinder-quobyte-4df6b739-fa94-4962-b649-0143d4648bcf" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:43:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Lock "cinder-quobyte-4df6b739-fa94-4962-b649-0143d4648bcf" acquired by "delete_volume" :: waited 0.040s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:43:54 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bf86dc-ccc8-407a-9a7a-a284265c556f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:43:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4df6b739-fa94-4962-b649-0143d4648bcf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:54 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4df6b739-fa94-4962-b649-0143d4648bcf Nov 06 10:43:54 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:55 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-14fd6026-0777-4374-a838-80eccf50ad72 req-6321ca99-d0ca-4e73-b5cb-d57dfd2c0d25 tempest-AttachVolumeTestJSON-723569238 None] Terminate volume connection completed successfully. Nov 06 10:43:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-14fd6026-0777-4374-a838-80eccf50ad72 req-6321ca99-d0ca-4e73-b5cb-d57dfd2c0d25 tempest-AttachVolumeTestJSON-723569238 None] Deleting attachment 000bbbfa-4311-43aa-9834-d8ade781b136. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:43:55 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4df6b739-fa94-4962-b649-0143d4648bcf" returned: 0 in 0.760s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4df6b739-fa94-4962-b649-0143d4648bcf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:55 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4df6b739-fa94-4962-b649-0143d4648bcf Nov 06 10:43:55 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:55 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4df6b739-fa94-4962-b649-0143d4648bcf" returned: 0 in 0.681s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Lock "cinder-quobyte-4df6b739-fa94-4962-b649-0143d4648bcf" released by "delete_volume" :: held 1.542s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:43:55 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Created reservations ['27bf990a-aa25-4df4-83b1-f6112a6f48ee', '72a840c1-7829-4e0c-8d78-156dbca383d5', 'cf3c7953-0690-4c6a-9160-4ca37eb3f2b1', '84837e7c-f7d3-4185-8bd4-86dfe4ff63c7'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:43:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:43:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:43:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:43:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:43:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:43:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:43:56 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:43:56 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:43:56 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Nov 06 10:43:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.489s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:43:56 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:43:56 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Deleted volume successfully. Nov 06 10:43:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8af4286f-e128-4efd-ad2a-c40b59ee1dd9 tempest-VolumeQuotasAdminTestJSON-1583562061 None] Lock "cinder-4df6b739-fa94-4962-b649-0143d4648bcf-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:43:56 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-c90ce7e3-0b0f-4c84-9a70-d53144efd13d req-6020c390-594e-4ee0-b590-ac28451ec742 tempest-AttachVolumeTestJSON-723569238 None] Terminate volume connection completed successfully. Nov 06 10:43:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-c90ce7e3-0b0f-4c84-9a70-d53144efd13d req-6020c390-594e-4ee0-b590-ac28451ec742 tempest-AttachVolumeTestJSON-723569238 None] Deleting attachment f27db758-eb31-4943-a192-2a2352062256. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:44:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "cinder-0c2d5095-7b0a-45ca-a75b-a91b08011e6a-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Lock "cinder-0c2d5095-7b0a-45ca-a75b-a91b08011e6a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "cinder-quobyte-0c2d5095-7b0a-45ca-a75b-a91b08011e6a" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Lock "cinder-quobyte-0c2d5095-7b0a-45ca-a75b-a91b08011e6a" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:05 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed7431f-5a47-4123-a62d-a4e8dff9f1ea]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:44:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:05 devstack sudo[94161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a Nov 06 10:44:05 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:05 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a" returned: 0 in 0.632s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:06 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a Nov 06 10:44:06 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:06 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0c2d5095-7b0a-45ca-a75b-a91b08011e6a" returned: 0 in 0.531s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Lock "cinder-quobyte-0c2d5095-7b0a-45ca-a75b-a91b08011e6a" released by "delete_volume" :: held 1.252s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:06 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Created reservations ['e4c874ab-9525-4797-ba3b-f9e107e8c516', '1ba5ea43-f7a6-4edf-909c-051fd086d901', '2dd8f9bd-9ce4-443c-828b-876f75a7ee40', 'c1d3de81-7d41-4abc-b115-4ef724e876ba'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:44:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:44:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:44:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:06 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:44:06 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:07 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-5c0e7c24-25aa-4b64-90be-ab737518f1ee req-cf6cb2f9-d562-4b81-8858-0d274659c99e tempest-ServerActionsTestOtherA-1183418255 None] Terminate volume connection completed successfully. Nov 06 10:44:07 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-5c0e7c24-25aa-4b64-90be-ab737518f1ee req-cf6cb2f9-d562-4b81-8858-0d274659c99e tempest-ServerActionsTestOtherA-1183418255 None] Deleting attachment bb2583a3-2898-446c-97d3-52df99a34dc5. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:44:07 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.602s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:07 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:44:07 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Deleted volume successfully. Nov 06 10:44:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-54e59d4d-1c2c-41ae-b867-c0aa7b1cf02e tempest-AttachVolumeTestJSON-723569238 None] Lock "cinder-0c2d5095-7b0a-45ca-a75b-a91b08011e6a-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "cinder-c3779f51-8b43-48b4-a4e2-344ff952cbbc-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Lock "cinder-c3779f51-8b43-48b4-a4e2-344ff952cbbc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "cinder-quobyte-c3779f51-8b43-48b4-a4e2-344ff952cbbc" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Lock "cinder-quobyte-c3779f51-8b43-48b4-a4e2-344ff952cbbc" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:07 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd4a47c-e82f-4018-9421-a3395872dd8e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:44:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:08 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc Nov 06 10:44:08 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:08 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc" returned: 0 in 0.603s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:08 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc Nov 06 10:44:08 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:08 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3779f51-8b43-48b4-a4e2-344ff952cbbc" returned: 0 in 0.433s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Lock "cinder-quobyte-c3779f51-8b43-48b4-a4e2-344ff952cbbc" released by "delete_volume" :: held 1.114s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:09 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Created reservations ['63acfc0d-cd23-4d54-a1e3-75456154f5e8', '693f527d-b603-4ca2-9359-9bb0610dd10d', '0709d48a-636e-4ef4-9830-99244bd34a17', '5561cbe9-91be-4239-8cd1-f279663c90bd'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:44:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:44:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:44:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:09 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:44:09 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:09 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.378s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:09 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:44:09 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Deleted volume successfully. Nov 06 10:44:09 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c0ab6ea8-40d9-4a3d-9fa3-163d70614c77 tempest-AttachVolumeTestJSON-723569238 None] Lock "cinder-c3779f51-8b43-48b4-a4e2-344ff952cbbc-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-5c0e7c24-25aa-4b64-90be-ab737518f1ee req-78123f1e-bfac-41bd-b0dc-c6f87e7742c1 tempest-ServerActionsTestOtherA-1183418255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-5c0e7c24-25aa-4b64-90be-ab737518f1ee req-78123f1e-bfac-41bd-b0dc-c6f87e7742c1 tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-5c0e7c24-25aa-4b64-90be-ab737518f1ee req-78123f1e-bfac-41bd-b0dc-c6f87e7742c1 tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-5c0e7c24-25aa-4b64-90be-ab737518f1ee req-78123f1e-bfac-41bd-b0dc-c6f87e7742c1 tempest-ServerActionsTestOtherA-1183418255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69683ea9-2fd6-4741-bcce-c5ea2c37347e', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:44:09 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-5c0e7c24-25aa-4b64-90be-ab737518f1ee req-78123f1e-bfac-41bd-b0dc-c6f87e7742c1 tempest-ServerActionsTestOtherA-1183418255 None] attachment_update completed successfully. Nov 06 10:44:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "cinder-2a786a48-a5f1-467d-86ef-4756754aaacf-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Lock "cinder-2a786a48-a5f1-467d-86ef-4756754aaacf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "cinder-quobyte-2a786a48-a5f1-467d-86ef-4756754aaacf" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Lock "cinder-quobyte-2a786a48-a5f1-467d-86ef-4756754aaacf" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:10 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d7ce69-8b0e-48fb-ae06-0a5f3a1c37eb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:44:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2a786a48-a5f1-467d-86ef-4756754aaacf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:10 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2a786a48-a5f1-467d-86ef-4756754aaacf Nov 06 10:44:10 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:11 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2a786a48-a5f1-467d-86ef-4756754aaacf" returned: 0 in 0.820s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2a786a48-a5f1-467d-86ef-4756754aaacf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:11 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2a786a48-a5f1-467d-86ef-4756754aaacf Nov 06 10:44:11 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:11 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2a786a48-a5f1-467d-86ef-4756754aaacf" returned: 0 in 0.428s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Lock "cinder-quobyte-2a786a48-a5f1-467d-86ef-4756754aaacf" released by "delete_volume" :: held 1.321s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:11 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Created reservations ['388b3252-132e-41d8-b8e0-61f6d84e6f14', 'eeea6515-a4a8-4683-b2c8-ea0212fa0595', '89399663-7851-463e-9f1f-d2fe4e9292c3', '3d059696-a770-4fe5-990e-32a4445d4e72'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:44:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:44:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:44:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:11 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:44:11 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:12 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.344s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:12 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:44:12 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Deleted volume successfully. Nov 06 10:44:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2a14354e-bf68-4836-b1fc-bf932aa77d48 tempest-AttachVolumeTestJSON-723569238 None] Lock "cinder-2a786a48-a5f1-467d-86ef-4756754aaacf-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:21 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=98,cinder:SELECT=98,cinder:INSERT=30,cinder:DELETE=6 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:44:22 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=93,cinder:SELECT=93,cinder:INSERT=22,cinder:DELETE=5 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Flow 'volume_create_manager' (25b8aae3-6734-4f9a-a6d7-ba020a7ef733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c675e42-575e-4884-ab66-07b6113a5533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c675e42-575e-4884-ab66-07b6113a5533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1203784986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f3c361-4407-43fd-a5c1-f502c240128c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b7fd3e0ec24a4a2aac5c6e3aa56abd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:44:30Z,use_quota=True,user_id='f5bbfad5ede5460fa425dbb0f308c387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21bee6f-837d-4562-975b-59f98b612708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21bee6f-837d-4562-975b-59f98b612708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f56e74-3b7d-4890-b5af-874ee3551a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f56e74-3b7d-4890-b5af-874ee3551a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f3c361-4407-43fd-a5c1-f502c240128c', 'volume_name': 'volume-82f3c361-4407-43fd-a5c1-f502c240128c', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca6ba0f-ff0c-462a-a7f8-cb72f0397e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca6ba0f-ff0c-462a-a7f8-cb72f0397e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb01751-0eb7-4ffb-bee5-ba05befaa908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:29 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Volume 82f3c361-4407-43fd-a5c1-f502c240128c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f3c361-4407-43fd-a5c1-f502c240128c', 'volume_size': 1} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1203784986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f3c361-4407-43fd-a5c1-f502c240128c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b7fd3e0ec24a4a2aac5c6e3aa56abd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:44:30Z,use_quota=True,user_id='f5bbfad5ede5460fa425dbb0f308c387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Creating volume 82f3c361-4407-43fd-a5c1-f502c240128c {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:44:29 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:44:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-82f3c361-4407-43fd-a5c1-f502c240128c 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:30 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-82f3c361-4407-43fd-a5c1-f502c240128c 1073741824 Nov 06 10:44:30 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:30 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-82f3c361-4407-43fd-a5c1-f502c240128c 1073741824" returned: 0 in 0.669s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-82f3c361-4407-43fd-a5c1-f502c240128c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:30 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-82f3c361-4407-43fd-a5c1-f502c240128c Nov 06 10:44:30 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:30 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-82f3c361-4407-43fd-a5c1-f502c240128c" returned: 0 in 0.290s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:44:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb01751-0eb7-4ffb-bee5-ba05befaa908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f3c361-4407-43fd-a5c1-f502c240128c', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bc0464-a239-4210-978e-439db6f1f10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:31 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Volume volume-82f3c361-4407-43fd-a5c1-f502c240128c (82f3c361-4407-43fd-a5c1-f502c240128c): created successfully Nov 06 10:44:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bc0464-a239-4210-978e-439db6f1f10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Flow 'volume_create_manager' (25b8aae3-6734-4f9a-a6d7-ba020a7ef733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:44:31 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-1e33cbb1-bab0-46d7-afc8-ad40f794dde7 tempest-VolumesTestJSON-1377610929 None] Created volume successfully. Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Flow 'volume_create_manager' (7bbc5300-dc78-4a0c-abac-3a48bec9affa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad12b6a1-629d-4640-ba03-a225182ba288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad12b6a1-629d-4640-ba03-a225182ba288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1106101418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b63440b-aae1-421c-a03c-24b95e81b70a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b7fd3e0ec24a4a2aac5c6e3aa56abd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:44:33Z,use_quota=True,user_id='f5bbfad5ede5460fa425dbb0f308c387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9fca87-eec7-426c-9ca6-c3613ceabd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9fca87-eec7-426c-9ca6-c3613ceabd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcebfa04-f507-40bf-8547-41224a5c99f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcebfa04-f507-40bf-8547-41224a5c99f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b63440b-aae1-421c-a03c-24b95e81b70a', 'volume_name': 'volume-8b63440b-aae1-421c-a03c-24b95e81b70a', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecc82b1-a6d4-4cec-9268-57cccb662016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecc82b1-a6d4-4cec-9268-57cccb662016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd8b5824-d2b2-4b78-a970-4b4b02d5e039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:32 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Volume 8b63440b-aae1-421c-a03c-24b95e81b70a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b63440b-aae1-421c-a03c-24b95e81b70a', 'volume_size': 1} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1106101418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b63440b-aae1-421c-a03c-24b95e81b70a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b7fd3e0ec24a4a2aac5c6e3aa56abd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:44:33Z,use_quota=True,user_id='f5bbfad5ede5460fa425dbb0f308c387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Creating volume 8b63440b-aae1-421c-a03c-24b95e81b70a {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:44:32 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:44:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8b63440b-aae1-421c-a03c-24b95e81b70a 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:32 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8b63440b-aae1-421c-a03c-24b95e81b70a 1073741824 Nov 06 10:44:32 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:33 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8b63440b-aae1-421c-a03c-24b95e81b70a 1073741824" returned: 0 in 0.807s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8b63440b-aae1-421c-a03c-24b95e81b70a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:33 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8b63440b-aae1-421c-a03c-24b95e81b70a Nov 06 10:44:33 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:34 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8b63440b-aae1-421c-a03c-24b95e81b70a" returned: 0 in 0.401s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:44:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd8b5824-d2b2-4b78-a970-4b4b02d5e039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b63440b-aae1-421c-a03c-24b95e81b70a', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df588cf6-18d5-421f-a397-1c1b2f696180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:34 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Volume volume-8b63440b-aae1-421c-a03c-24b95e81b70a (8b63440b-aae1-421c-a03c-24b95e81b70a): created successfully Nov 06 10:44:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df588cf6-18d5-421f-a397-1c1b2f696180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Flow 'volume_create_manager' (7bbc5300-dc78-4a0c-abac-3a48bec9affa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:44:34 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-202c55b3-d1cc-4117-b934-c09b340ec7e2 tempest-VolumesTestJSON-1377610929 None] Created volume successfully. Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Flow 'volume_create_manager' (1c3e7852-bb89-44a1-994c-1653cddff8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51ccc23-ee05-4fe7-9cca-65cf9033f250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51ccc23-ee05-4fe7-9cca-65cf9033f250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1744098958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a77a191-4116-4be6-8d34-7e55fb88aa4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b7fd3e0ec24a4a2aac5c6e3aa56abd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:44:36Z,use_quota=True,user_id='f5bbfad5ede5460fa425dbb0f308c387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16afe93b-5425-44ff-9bb6-d5db0b6cc466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16afe93b-5425-44ff-9bb6-d5db0b6cc466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0794b55e-32a5-4cf2-9521-cbdbf8240ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0794b55e-32a5-4cf2-9521-cbdbf8240ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a77a191-4116-4be6-8d34-7e55fb88aa4e', 'volume_name': 'volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865a6c42-7890-4415-82b8-8a2cb280e768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865a6c42-7890-4415-82b8-8a2cb280e768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dd253e-ee58-4182-9cc4-675a7f64c9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:35 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Volume 9a77a191-4116-4be6-8d34-7e55fb88aa4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e', 'volume_size': 1} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1744098958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a77a191-4116-4be6-8d34-7e55fb88aa4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b7fd3e0ec24a4a2aac5c6e3aa56abd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:44:36Z,use_quota=True,user_id='f5bbfad5ede5460fa425dbb0f308c387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Creating volume 9a77a191-4116-4be6-8d34-7e55fb88aa4e {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:44:35 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:44:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:35 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e 1073741824 Nov 06 10:44:35 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:44:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:44:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:44:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:36 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:44:36 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:36 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.532s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:44:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:44:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 28 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:44:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:44:36 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e 1073741824" returned: 0 in 0.918s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:36 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e Nov 06 10:44:36 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:37 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e" returned: 0 in 0.423s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:44:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dd253e-ee58-4182-9cc4-675a7f64c9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c64abf0-3e7e-41c0-b2d1-7184462a6aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:37 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Volume volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e (9a77a191-4116-4be6-8d34-7e55fb88aa4e): created successfully Nov 06 10:44:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c64abf0-3e7e-41c0-b2d1-7184462a6aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Flow 'volume_create_manager' (1c3e7852-bb89-44a1-994c-1653cddff8cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:44:37 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a20a8616-616e-4daa-95be-4f70c0d6c563 tempest-VolumesTestJSON-1377610929 None] Created volume successfully. Nov 06 10:44:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Acquiring lock "cinder-9a77a191-4116-4be6-8d34-7e55fb88aa4e-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Lock "cinder-9a77a191-4116-4be6-8d34-7e55fb88aa4e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Acquiring lock "cinder-quobyte-9a77a191-4116-4be6-8d34-7e55fb88aa4e" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Lock "cinder-quobyte-9a77a191-4116-4be6-8d34-7e55fb88aa4e" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:39 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c367bf1b-ed8e-4034-a14f-878f28ef9ec5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:44:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:39 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e Nov 06 10:44:39 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:39 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e" returned: 0 in 0.466s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:39 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e Nov 06 10:44:39 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:40 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9a77a191-4116-4be6-8d34-7e55fb88aa4e" returned: 0 in 0.363s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Lock "cinder-quobyte-9a77a191-4116-4be6-8d34-7e55fb88aa4e" released by "delete_volume" :: held 0.910s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Created reservations ['fb290312-9f6c-417b-8c39-7b49b6922062', 'a441a3c6-a26a-4ee0-afdc-c356db84c8ce', '81b84ce9-fbba-43d1-9006-c6920222c7ff', 'f2548922-92d8-4e2f-b4e5-d0ded2c722a0'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:40 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:44:40 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Acquiring lock "cinder-8b63440b-aae1-421c-a03c-24b95e81b70a-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Lock "cinder-8b63440b-aae1-421c-a03c-24b95e81b70a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Acquiring lock "cinder-quobyte-8b63440b-aae1-421c-a03c-24b95e81b70a" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Lock "cinder-quobyte-8b63440b-aae1-421c-a03c-24b95e81b70a" acquired by "delete_volume" :: waited 0.033s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[21490021-76fa-4c15-afdc-5745c56ec6ed]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8b63440b-aae1-421c-a03c-24b95e81b70a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:40 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.393s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:44:40 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Deleted volume successfully. Nov 06 10:44:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b969bf06-c75b-4417-a063-261e30d6a680 tempest-VolumesTestJSON-1377610929 None] Lock "cinder-9a77a191-4116-4be6-8d34-7e55fb88aa4e-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:40 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8b63440b-aae1-421c-a03c-24b95e81b70a Nov 06 10:44:40 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:41 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8b63440b-aae1-421c-a03c-24b95e81b70a" returned: 0 in 0.475s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8b63440b-aae1-421c-a03c-24b95e81b70a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:41 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8b63440b-aae1-421c-a03c-24b95e81b70a Nov 06 10:44:41 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:41 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8b63440b-aae1-421c-a03c-24b95e81b70a" returned: 0 in 0.452s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Lock "cinder-quobyte-8b63440b-aae1-421c-a03c-24b95e81b70a" released by "delete_volume" :: held 0.987s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Created reservations ['edc79417-7353-4a6b-b28f-d4c23340e1b3', '1885c51c-f2fd-46b2-b3e7-58e12ee1eb70', 'f0360cd9-876c-4f2f-8a3d-9000877ef53c', 'd513585e-2ee3-417f-9e03-881613eca2e8'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Flow 'volume_create_manager' (755790dd-9122-476c-84bd-e97f4b9b57bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfc3143-8a55-4ee4-ad71-034c7d5266eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfc3143-8a55-4ee4-ad71-034c7d5266eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2056192187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee51228-443a-443d-a593-c63f6cfe1a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f251e2623144f28bb7e23bb126c0ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:44:42Z,use_quota=True,user_id='6e47c38a574d4a4f8a888da7494780ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a6af2e-b944-4bfa-b3ec-461f3f12be2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a6af2e-b944-4bfa-b3ec-461f3f12be2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80202090-5a68-410e-b8d1-06f7f95eddc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80202090-5a68-410e-b8d1-06f7f95eddc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dee51228-443a-443d-a593-c63f6cfe1a80', 'volume_name': 'volume-dee51228-443a-443d-a593-c63f6cfe1a80', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db939d46-8086-4f37-a9fb-9de86a31ff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db939d46-8086-4f37-a9fb-9de86a31ff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8ff472-574b-4ffe-8dc5-a789617e8bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:41 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Volume dee51228-443a-443d-a593-c63f6cfe1a80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dee51228-443a-443d-a593-c63f6cfe1a80', 'volume_size': 1} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2056192187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee51228-443a-443d-a593-c63f6cfe1a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f251e2623144f28bb7e23bb126c0ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:44:42Z,use_quota=True,user_id='6e47c38a574d4a4f8a888da7494780ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Creating volume dee51228-443a-443d-a593-c63f6cfe1a80 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:44:41 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dee51228-443a-443d-a593-c63f6cfe1a80 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:41 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dee51228-443a-443d-a593-c63f6cfe1a80 1073741824 Nov 06 10:44:41 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:41 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:44:41 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:42 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.549s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:42 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:44:42 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Deleted volume successfully. Nov 06 10:44:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a3570503-f482-47d0-aee4-550c47e9edf1 tempest-VolumesTestJSON-1377610929 None] Lock "cinder-8b63440b-aae1-421c-a03c-24b95e81b70a-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:42 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dee51228-443a-443d-a593-c63f6cfe1a80 1073741824" returned: 0 in 0.820s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dee51228-443a-443d-a593-c63f6cfe1a80 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:42 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dee51228-443a-443d-a593-c63f6cfe1a80 Nov 06 10:44:42 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Acquiring lock "cinder-82f3c361-4407-43fd-a5c1-f502c240128c-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Lock "cinder-82f3c361-4407-43fd-a5c1-f502c240128c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:43 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Acquiring lock "cinder-quobyte-82f3c361-4407-43fd-a5c1-f502c240128c" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:43 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Lock "cinder-quobyte-82f3c361-4407-43fd-a5c1-f502c240128c" acquired by "delete_volume" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:43 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bc07d7-d49e-45f6-a80c-6f9e72080b89]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:44:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-82f3c361-4407-43fd-a5c1-f502c240128c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:43 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dee51228-443a-443d-a593-c63f6cfe1a80" returned: 0 in 0.587s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:44:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:43 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-82f3c361-4407-43fd-a5c1-f502c240128c Nov 06 10:44:43 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8ff472-574b-4ffe-8dc5-a789617e8bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee51228-443a-443d-a593-c63f6cfe1a80', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b416fe24-424d-4655-8873-0ea1609c746e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:44:43 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Volume volume-dee51228-443a-443d-a593-c63f6cfe1a80 (dee51228-443a-443d-a593-c63f6cfe1a80): created successfully Nov 06 10:44:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b416fe24-424d-4655-8873-0ea1609c746e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:44:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Flow 'volume_create_manager' (755790dd-9122-476c-84bd-e97f4b9b57bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:44:43 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-0ad72324-aadd-4141-bc54-7d494bb95840 tempest-AbsoluteLimitsTests-2096272245 None] Created volume successfully. Nov 06 10:44:43 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-82f3c361-4407-43fd-a5c1-f502c240128c" returned: 0 in 0.615s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-82f3c361-4407-43fd-a5c1-f502c240128c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:43 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-82f3c361-4407-43fd-a5c1-f502c240128c Nov 06 10:44:43 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Acquiring lock "cinder-dee51228-443a-443d-a593-c63f6cfe1a80-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Lock "cinder-dee51228-443a-443d-a593-c63f6cfe1a80-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Acquiring lock "cinder-quobyte-dee51228-443a-443d-a593-c63f6cfe1a80" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:44 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-82f3c361-4407-43fd-a5c1-f502c240128c" returned: 0 in 0.480s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Lock "cinder-quobyte-dee51228-443a-443d-a593-c63f6cfe1a80" acquired by "delete_volume" :: waited 0.062s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Lock "cinder-quobyte-82f3c361-4407-43fd-a5c1-f502c240128c" released by "delete_volume" :: held 1.240s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38f93df-88f9-4d98-b4d8-b699d8477434]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dee51228-443a-443d-a593-c63f6cfe1a80 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:44 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-c25ea11d-f860-4339-8961-413b12b795d7 req-de127d85-7aea-4627-98ba-ea0607f3e804 tempest-ServerActionsTestOtherA-1183418255 None] Terminate volume connection completed successfully. Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-c25ea11d-f860-4339-8961-413b12b795d7 req-de127d85-7aea-4627-98ba-ea0607f3e804 tempest-ServerActionsTestOtherA-1183418255 None] Deleting attachment 69683ea9-2fd6-4741-bcce-c5ea2c37347e. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Created reservations ['eb3a6e43-175d-4509-ab0d-70596407139e', '0bca8c6e-c5a7-4009-958f-f3733abe6248', '83cbb42c-630a-4ea7-98d4-dcd9003fc61c', 'fe0ca25c-7f5d-420d-90fa-fb8ca5cd112c'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:44:44 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dee51228-443a-443d-a593-c63f6cfe1a80 Nov 06 10:44:44 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Acquiring lock "cinder-96309ac2-77a4-41c0-83da-6efef3e3b7a4-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:44 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:44:44 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Lock "cinder-96309ac2-77a4-41c0-83da-6efef3e3b7a4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Acquiring lock "cinder-quobyte-96309ac2-77a4-41c0-83da-6efef3e3b7a4" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Lock "cinder-quobyte-96309ac2-77a4-41c0-83da-6efef3e3b7a4" acquired by "delete_volume" :: waited 0.038s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fff8be-19e9-4310-a256-1a64d9d59bbd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:44:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:44 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 Nov 06 10:44:45 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:45 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dee51228-443a-443d-a593-c63f6cfe1a80" returned: 0 in 0.639s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dee51228-443a-443d-a593-c63f6cfe1a80 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:45 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.461s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:44:45 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Deleted volume successfully. Nov 06 10:44:45 devstack sudo[94971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dee51228-443a-443d-a593-c63f6cfe1a80 Nov 06 10:44:45 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ff09c0b5-b801-4f8b-982e-c57b74e6b631 tempest-VolumesTestJSON-1377610929 None] Lock "cinder-82f3c361-4407-43fd-a5c1-f502c240128c-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:45 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4" returned: 0 in 0.574s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:45 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dee51228-443a-443d-a593-c63f6cfe1a80" returned: 0 in 0.420s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:45 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4 Nov 06 10:44:45 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Lock "cinder-quobyte-dee51228-443a-443d-a593-c63f6cfe1a80" released by "delete_volume" :: held 1.122s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Created reservations ['77bf040f-0b30-4e8b-9370-9c0036581e39', 'fbd3584a-7ee4-4403-86d9-1d338bf5422a', '9090d554-5c1e-44ad-b620-9b3793c6b2ea', '974089b6-23e8-44de-bee9-32c026629587'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:45 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:44:45 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:45 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-96309ac2-77a4-41c0-83da-6efef3e3b7a4" returned: 0 in 0.499s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Acquiring lock "cinder-fe19a64a-30a0-44c8-83da-9e8403dc5299-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Lock "cinder-quobyte-96309ac2-77a4-41c0-83da-6efef3e3b7a4" released by "delete_volume" :: held 1.196s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Lock "cinder-fe19a64a-30a0-44c8-83da-9e8403dc5299-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Acquiring lock "cinder-quobyte-fe19a64a-30a0-44c8-83da-9e8403dc5299" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:44:46 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Lock "cinder-quobyte-fe19a64a-30a0-44c8-83da-9e8403dc5299" acquired by "delete_volume" :: waited 0.032s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.451s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG cinder.quota [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Created reservations ['e31f38de-9b73-4ba9-ae94-21583df2f95c', 'e2449c77-3cc4-45be-8bb4-1c2664142987', '6e113fec-6d01-40df-ae8c-9275fe26c876', '6a4f432d-9d79-4342-9d80-42ccd698b199'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:44:46 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Deleted volume successfully. Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[73537ba9-130a-4cc5-a2b0-43f1f9af4a5b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fe19a64a-30a0-44c8-83da-9e8403dc5299 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5c26626a-52b6-4d48-8bfc-3afb18eac6f7 tempest-AbsoluteLimitsTests-2096272245 None] Lock "cinder-dee51228-443a-443d-a593-c63f6cfe1a80-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:46 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:44:46 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:46 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fe19a64a-30a0-44c8-83da-9e8403dc5299 Nov 06 10:44:46 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:46 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.356s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG cinder.manager [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:44:46 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:46 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Deleted volume successfully. Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fe19a64a-30a0-44c8-83da-9e8403dc5299" returned: 0 in 0.492s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fe19a64a-30a0-44c8-83da-9e8403dc5299 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-c25ea11d-f860-4339-8961-413b12b795d7 req-a38e3495-ff63-40aa-bdf1-09ef741f4f8c tempest-ServerActionsTestOtherA-1183418255 None] Lock "cinder-96309ac2-77a4-41c0-83da-6efef3e3b7a4-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:46 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fe19a64a-30a0-44c8-83da-9e8403dc5299 Nov 06 10:44:46 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:47 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fe19a64a-30a0-44c8-83da-9e8403dc5299" returned: 0 in 0.398s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Lock "cinder-quobyte-fe19a64a-30a0-44c8-83da-9e8403dc5299" released by "delete_volume" :: held 0.981s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:47 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Created reservations ['a99ffd22-fa86-45cf-ac92-f7531445907b', '9a8f861f-379a-4880-aab7-97e85aa63991', '1be9ecb9-2ea3-41d6-8b89-9e4963a01083', '8f5b6762-8d9e-4f73-bd22-1f3166c7bf2c'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:44:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:44:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:44:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:44:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:44:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:44:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:44:47 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:44:47 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:44:47 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Nov 06 10:44:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.362s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:44:47 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:44:47 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Deleted volume successfully. Nov 06 10:44:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-19f893d1-3960-4c2f-8fc8-2bbd61a1b039 tempest-ServerActionsTestOtherA-1183418255 None] Lock "cinder-fe19a64a-30a0-44c8-83da-9e8403dc5299-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:44:57 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=41,cinder:UPDATE=58,cinder:DELETE=6,cinder:INSERT=11 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:44:57 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=37,cinder:UPDATE=62,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Flow 'volume_create_manager' (d476fe2b-20cc-4ff8-9094-c8172a065608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f412968-5418-4c0b-8fb5-ea3d83bb477b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f412968-5418-4c0b-8fb5-ea3d83bb477b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1994636960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d48567-14cd-402b-9010-06696b0595fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a0c02fdac44d793b586450ce5a515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:45:01Z,use_quota=True,user_id='4dd5b0cbf7d34e44aeaaccde209a98b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbee68b-9b12-41c7-9bcd-3ea6f476f6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbee68b-9b12-41c7-9bcd-3ea6f476f6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b16dbd-66f6-4e1d-9d50-0629572c1b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b16dbd-66f6-4e1d-9d50-0629572c1b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d48567-14cd-402b-9010-06696b0595fd', 'volume_name': 'volume-05d48567-14cd-402b-9010-06696b0595fd', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df07e40-27d3-4080-982a-98e7a3400eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df07e40-27d3-4080-982a-98e7a3400eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a224e0-4157-4063-9f6f-f3b3fbc17e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:00 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Volume 05d48567-14cd-402b-9010-06696b0595fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d48567-14cd-402b-9010-06696b0595fd', 'volume_size': 1} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1994636960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d48567-14cd-402b-9010-06696b0595fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a0c02fdac44d793b586450ce5a515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:45:01Z,use_quota=True,user_id='4dd5b0cbf7d34e44aeaaccde209a98b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Creating volume 05d48567-14cd-402b-9010-06696b0595fd {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:45:00 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:45:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-05d48567-14cd-402b-9010-06696b0595fd 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:00 devstack sudo[95082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-05d48567-14cd-402b-9010-06696b0595fd 1073741824 Nov 06 10:45:00 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:01 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-05d48567-14cd-402b-9010-06696b0595fd 1073741824" returned: 0 in 0.885s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-05d48567-14cd-402b-9010-06696b0595fd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:01 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-05d48567-14cd-402b-9010-06696b0595fd Nov 06 10:45:01 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:02 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-05d48567-14cd-402b-9010-06696b0595fd" returned: 0 in 0.328s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:45:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a224e0-4157-4063-9f6f-f3b3fbc17e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d48567-14cd-402b-9010-06696b0595fd', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342020ab-d6aa-445c-bc4c-ae3757f4ffe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:02 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Volume volume-05d48567-14cd-402b-9010-06696b0595fd (05d48567-14cd-402b-9010-06696b0595fd): created successfully Nov 06 10:45:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342020ab-d6aa-445c-bc4c-ae3757f4ffe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Flow 'volume_create_manager' (d476fe2b-20cc-4ff8-9094-c8172a065608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:45:02 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-f643e656-3c35-4152-86ad-d93730cdffeb tempest-AttachVolumeNegativeTest-1480812843 None] Created volume successfully. Nov 06 10:45:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-2f28b81b-f44e-4fbe-9642-91302b119d79 req-7473dcea-e37a-4f05-8e50-cbf189dc6d9a tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-2f28b81b-f44e-4fbe-9642-91302b119d79 req-7473dcea-e37a-4f05-8e50-cbf189dc6d9a tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-2f28b81b-f44e-4fbe-9642-91302b119d79 req-7473dcea-e37a-4f05-8e50-cbf189dc6d9a tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-2f28b81b-f44e-4fbe-9642-91302b119d79 req-7473dcea-e37a-4f05-8e50-cbf189dc6d9a tempest-AttachVolumeNegativeTest-1480812843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-05d48567-14cd-402b-9010-06696b0595fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23fa439b-ae1b-44d6-b83d-fc1f931c3c16', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:45:03 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-2f28b81b-f44e-4fbe-9642-91302b119d79 req-7473dcea-e37a-4f05-8e50-cbf189dc6d9a tempest-AttachVolumeNegativeTest-1480812843 None] attachment_update completed successfully. Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Flow 'volume_create_manager' (bf026510-f9f9-45e1-b2b6-c1fd9a6a7a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076194e9-7f82-498f-8484-3d560a521b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076194e9-7f82-498f-8484-3d560a521b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1578707481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df9a9a0-a405-4c77-be39-07d4fa37f420,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c36ac3a542f944ce97fa07ab9d87a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:45:04Z,use_quota=True,user_id='ca5e2a6ed3a74a179e438a2ece070ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb86901-dfc5-4fa0-b31b-441ee157ff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb86901-dfc5-4fa0-b31b-441ee157ff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b4f3ba-6f96-4221-b934-30dcc04c4848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b4f3ba-6f96-4221-b934-30dcc04c4848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7df9a9a0-a405-4c77-be39-07d4fa37f420', 'volume_name': 'volume-7df9a9a0-a405-4c77-be39-07d4fa37f420', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6975ea-742f-4106-9ef9-9752cf64be46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6975ea-742f-4106-9ef9-9752cf64be46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278db051-ab29-4639-8177-3482976f99cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:04 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Volume 7df9a9a0-a405-4c77-be39-07d4fa37f420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7df9a9a0-a405-4c77-be39-07d4fa37f420', 'volume_size': 1} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1578707481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df9a9a0-a405-4c77-be39-07d4fa37f420,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c36ac3a542f944ce97fa07ab9d87a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:45:04Z,use_quota=True,user_id='ca5e2a6ed3a74a179e438a2ece070ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Creating volume 7df9a9a0-a405-4c77-be39-07d4fa37f420 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:45:04 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7df9a9a0-a405-4c77-be39-07d4fa37f420 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:04 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7df9a9a0-a405-4c77-be39-07d4fa37f420 1073741824 Nov 06 10:45:04 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:04 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7df9a9a0-a405-4c77-be39-07d4fa37f420 1073741824" returned: 0 in 0.662s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7df9a9a0-a405-4c77-be39-07d4fa37f420 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:04 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7df9a9a0-a405-4c77-be39-07d4fa37f420 Nov 06 10:45:04 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:05 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7df9a9a0-a405-4c77-be39-07d4fa37f420" returned: 0 in 0.322s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278db051-ab29-4639-8177-3482976f99cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7df9a9a0-a405-4c77-be39-07d4fa37f420', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53de1c6f-2020-4adc-8772-d590bcaf5c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Flow 'volume_create_manager' (0f27047e-0839-4278-ae91-2f29ecc28eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355bce96-b35d-4767-a0d5-711f2a4c2bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:05 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Volume volume-7df9a9a0-a405-4c77-be39-07d4fa37f420 (7df9a9a0-a405-4c77-be39-07d4fa37f420): created successfully Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53de1c6f-2020-4adc-8772-d590bcaf5c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Flow 'volume_create_manager' (bf026510-f9f9-45e1-b2b6-c1fd9a6a7a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355bce96-b35d-4767-a0d5-711f2a4c2bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1014858567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bde55a-bde8-42e5-8f7e-173c98c5f961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f3a73fb74d4112a59d19c6e9c0dc46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:45:05Z,use_quota=True,user_id='3fb8d280cd5a4f0c8ea6917be7a437e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74911605-3822-450a-9574-d82bf09f5187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74911605-3822-450a-9574-d82bf09f5187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfe410d-242c-49a3-9056-b790b984c96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfe410d-242c-49a3-9056-b790b984c96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0bde55a-bde8-42e5-8f7e-173c98c5f961', 'volume_name': 'volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e50efb-68c5-47cb-9d36-382ab7f04c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e50efb-68c5-47cb-9d36-382ab7f04c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff6c0e5-f0ea-4868-b4f5-f35b363b2236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:05 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Volume e0bde55a-bde8-42e5-8f7e-173c98c5f961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961', 'volume_size': 1} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1014858567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bde55a-bde8-42e5-8f7e-173c98c5f961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f3a73fb74d4112a59d19c6e9c0dc46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:45:05Z,use_quota=True,user_id='3fb8d280cd5a4f0c8ea6917be7a437e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Creating volume e0bde55a-bde8-42e5-8f7e-173c98c5f961 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:45:05 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:05 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-0b011274-8484-4c2f-86ee-c34801a2894d req-49154790-3183-467e-865d-9c78900d3437 tempest-VolumesGetTestJSON-666469424 None] Created volume successfully. Nov 06 10:45:05 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 1073741824 Nov 06 10:45:05 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:05 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 1073741824" returned: 0 in 0.538s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:05 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 Nov 06 10:45:05 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:06 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961" returned: 0 in 0.295s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:45:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff6c0e5-f0ea-4868-b4f5-f35b363b2236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e894f9a6-7318-4f59-937d-4f9e13484201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:06 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Volume volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 (e0bde55a-bde8-42e5-8f7e-173c98c5f961): created successfully Nov 06 10:45:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e894f9a6-7318-4f59-937d-4f9e13484201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Flow 'volume_create_manager' (0f27047e-0839-4278-ae91-2f29ecc28eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:45:06 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-60824851-4037-4d9d-b606-281fb3bd4be4 tempest-VolumesActionsTest-685125030 None] Created volume successfully. Nov 06 10:45:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Acquiring lock "cinder-7df9a9a0-a405-4c77-be39-07d4fa37f420-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:45:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Lock "cinder-7df9a9a0-a405-4c77-be39-07d4fa37f420-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:45:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Acquiring lock "cinder-quobyte-7df9a9a0-a405-4c77-be39-07d4fa37f420" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:45:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Lock "cinder-quobyte-7df9a9a0-a405-4c77-be39-07d4fa37f420" acquired by "delete_volume" :: waited 0.048s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:45:07 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bccec94-cfb7-4032-a666-57bc1fbe304f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:45:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7df9a9a0-a405-4c77-be39-07d4fa37f420 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:07 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7df9a9a0-a405-4c77-be39-07d4fa37f420 Nov 06 10:45:07 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:07 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7df9a9a0-a405-4c77-be39-07d4fa37f420" returned: 0 in 0.519s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7df9a9a0-a405-4c77-be39-07d4fa37f420 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:07 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7df9a9a0-a405-4c77-be39-07d4fa37f420 Nov 06 10:45:07 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:07 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7df9a9a0-a405-4c77-be39-07d4fa37f420" returned: 0 in 0.310s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Lock "cinder-quobyte-7df9a9a0-a405-4c77-be39-07d4fa37f420" released by "delete_volume" :: held 0.899s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:45:07 devstack cinder-volume[86819]: DEBUG cinder.quota [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Created reservations ['a7736c85-c30b-4780-95ba-638477466f2d', 'f86c1657-ae91-40a9-96cd-42071821ae03', 'f495e240-2906-4ebe-a06c-32344e2524cf', '1e338796-63ef-4ffa-9e02-4c6078ecf606'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:45:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:45:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:45:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:08 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:45:08 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:08 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.418s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:08 devstack cinder-volume[86819]: DEBUG cinder.manager [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:45:08 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Deleted volume successfully. Nov 06 10:45:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-0225e035-569c-4cf1-a6f6-1ed4996e342d req-57fa08f5-b178-4243-b1bf-86834b8da8d2 tempest-VolumesGetTestJSON-666469424 None] Lock "cinder-7df9a9a0-a405-4c77-be39-07d4fa37f420-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:45:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ad74a270-0f7b-43d8-a5d5-232d97e955eb tempest-VolumesActionsTest-685125030 None] Acquiring lock "cinder-e0bde55a-bde8-42e5-8f7e-173c98c5f961" by "attach_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:45:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ad74a270-0f7b-43d8-a5d5-232d97e955eb tempest-VolumesActionsTest-685125030 None] Lock "cinder-e0bde55a-bde8-42e5-8f7e-173c98c5f961" acquired by "attach_volume" :: waited 0.049s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:45:18 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ad74a270-0f7b-43d8-a5d5-232d97e955eb tempest-VolumesActionsTest-685125030 None] Attaching volume e0bde55a-bde8-42e5-8f7e-173c98c5f961 to instance a4ea72da-723e-4b8a-b7f6-bd58a54a1428 at mountpoint /dev/vdb on host None. Nov 06 10:45:18 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ad74a270-0f7b-43d8-a5d5-232d97e955eb tempest-VolumesActionsTest-685125030 None] Attach volume completed successfully. Nov 06 10:45:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ad74a270-0f7b-43d8-a5d5-232d97e955eb tempest-VolumesActionsTest-685125030 None] Lock "cinder-e0bde55a-bde8-42e5-8f7e-173c98c5f961" released by "attach_volume" :: held 0.476s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:45:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fa688630-5e86-47eb-8eb1-cb084d64f1e1 tempest-VolumesActionsTest-685125030 None] Acquiring lock "cinder-e0bde55a-bde8-42e5-8f7e-173c98c5f961-detach_volume" by "detach_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:45:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fa688630-5e86-47eb-8eb1-cb084d64f1e1 tempest-VolumesActionsTest-685125030 None] Lock "cinder-e0bde55a-bde8-42e5-8f7e-173c98c5f961-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:45:18 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-fa688630-5e86-47eb-8eb1-cb084d64f1e1 tempest-VolumesActionsTest-685125030 None] Detaching volume e0bde55a-bde8-42e5-8f7e-173c98c5f961 from instance a4ea72da-723e-4b8a-b7f6-bd58a54a1428. Nov 06 10:45:19 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-fa688630-5e86-47eb-8eb1-cb084d64f1e1 tempest-VolumesActionsTest-685125030 None] Detach volume completed successfully. Nov 06 10:45:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fa688630-5e86-47eb-8eb1-cb084d64f1e1 tempest-VolumesActionsTest-685125030 None] Lock "cinder-e0bde55a-bde8-42e5-8f7e-173c98c5f961-detach_volume" released by "detach_volume" :: held 0.304s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Flow 'volume_create_manager' (379d240d-dd25-4478-8b01-8c572c04df35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3b01f9-006d-4002-abd5-a49cc6426c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3b01f9-006d-4002-abd5-a49cc6426c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-607851957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce444d2a-906c-4545-b738-9544ea74a584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5badd24c5a481cbbab4837236a80e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:45:26Z,use_quota=True,user_id='f7c0c018d03d4aa3a46d7f9eb547f357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446682dc-3d4d-45f3-9789-18ce209e9218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446682dc-3d4d-45f3-9789-18ce209e9218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375121fa-474f-454a-9e6c-264c2f376dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375121fa-474f-454a-9e6c-264c2f376dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce444d2a-906c-4545-b738-9544ea74a584', 'volume_name': 'volume-ce444d2a-906c-4545-b738-9544ea74a584', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e3a4d2-d0bb-4e5e-ab69-70cdf2423059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e3a4d2-d0bb-4e5e-ab69-70cdf2423059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a054a37-bee1-42b5-9c11-662aba3ce3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:26 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Volume ce444d2a-906c-4545-b738-9544ea74a584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce444d2a-906c-4545-b738-9544ea74a584', 'volume_size': 1} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-607851957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce444d2a-906c-4545-b738-9544ea74a584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5badd24c5a481cbbab4837236a80e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:45:26Z,use_quota=True,user_id='f7c0c018d03d4aa3a46d7f9eb547f357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Creating volume ce444d2a-906c-4545-b738-9544ea74a584 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:45:26 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:45:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ce444d2a-906c-4545-b738-9544ea74a584 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:26 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ce444d2a-906c-4545-b738-9544ea74a584 1073741824 Nov 06 10:45:26 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:27 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ce444d2a-906c-4545-b738-9544ea74a584 1073741824" returned: 0 in 0.699s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ce444d2a-906c-4545-b738-9544ea74a584 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:27 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ce444d2a-906c-4545-b738-9544ea74a584 Nov 06 10:45:27 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:27 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ce444d2a-906c-4545-b738-9544ea74a584" returned: 0 in 0.448s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:45:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a054a37-bee1-42b5-9c11-662aba3ce3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce444d2a-906c-4545-b738-9544ea74a584', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19300220-9682-4e13-bad9-ef637d228ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:27 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Volume volume-ce444d2a-906c-4545-b738-9544ea74a584 (ce444d2a-906c-4545-b738-9544ea74a584): created successfully Nov 06 10:45:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19300220-9682-4e13-bad9-ef637d228ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Flow 'volume_create_manager' (379d240d-dd25-4478-8b01-8c572c04df35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:45:27 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c2db24a4-2a9d-43cb-bf91-e2dc88629531 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Created volume successfully. Nov 06 10:45:28 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-8da5d94b-0de0-4648-a23b-9ee68a475df1 tempest-GroupsTest-670453874 None] Group tempest-Group1-1497283808: creating Nov 06 10:45:28 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-8da5d94b-0de0-4648-a23b-9ee68a475df1 tempest-GroupsTest-670453874 None] Group tempest-Group1-1497283808: created successfully Nov 06 10:45:28 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-8da5d94b-0de0-4648-a23b-9ee68a475df1 tempest-GroupsTest-670453874 None] Create group completed successfully. Nov 06 10:45:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Acquiring lock "cinder-ce444d2a-906c-4545-b738-9544ea74a584-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:45:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Lock "cinder-ce444d2a-906c-4545-b738-9544ea74a584-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:45:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Acquiring lock "cinder-quobyte-ce444d2a-906c-4545-b738-9544ea74a584" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:45:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Lock "cinder-quobyte-ce444d2a-906c-4545-b738-9544ea74a584" acquired by "delete_volume" :: waited 0.042s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:45:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7182d45e-8efc-42f0-b723-c734fd78ae78 tempest-GroupsTest-670453874 None] Group tempest-Group2-663451788: creating Nov 06 10:45:30 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[83447621-d919-4806-996c-c781f51db7cc]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:45:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ce444d2a-906c-4545-b738-9544ea74a584 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7182d45e-8efc-42f0-b723-c734fd78ae78 tempest-GroupsTest-670453874 None] Group tempest-Group2-663451788: created successfully Nov 06 10:45:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7182d45e-8efc-42f0-b723-c734fd78ae78 tempest-GroupsTest-670453874 None] Create group completed successfully. Nov 06 10:45:30 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ce444d2a-906c-4545-b738-9544ea74a584 Nov 06 10:45:30 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:30 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ce444d2a-906c-4545-b738-9544ea74a584" returned: 0 in 0.483s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ce444d2a-906c-4545-b738-9544ea74a584 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:30 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ce444d2a-906c-4545-b738-9544ea74a584 Nov 06 10:45:30 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:31 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ce444d2a-906c-4545-b738-9544ea74a584" returned: 0 in 0.605s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Lock "cinder-quobyte-ce444d2a-906c-4545-b738-9544ea74a584" released by "delete_volume" :: held 1.212s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:45:31 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Created reservations ['fbaea45e-b4d4-4cb3-ab30-ce26d5b257d9', '87e694c4-8185-4116-adfd-de63d1e228c1', '55938170-8e1d-454d-befd-181e7be7aadd', '94adf232-ff52-43be-88ca-e2d0cea68de7'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:45:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:45:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:45:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:32 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:45:32 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:32 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.778s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:32 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:45:32 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Deleted volume successfully. Nov 06 10:45:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d756513a-5eb2-40d6-961e-28670284fe09 tempest-VolumeQuotasNegativeTestJSON-2055140203 None] Lock "cinder-ce444d2a-906c-4545-b738-9544ea74a584-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:45:32 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Flow 'volume_create_manager' (10090808-a385-404e-965b-cf139222d520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6dff86-201c-4d99-b3eb-6b7578926838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6dff86-201c-4d99-b3eb-6b7578926838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858051779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e709f332-6a25-429a-a882-cec29e4e0c42,host='devstack@QuobyteHD#QuobyteHD',id=94903123-9984-4612-a4ca-e48c8a924b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb05627d8f24c0a95bd5f0c7e58c303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:45:33Z,use_quota=True,user_id='029cbd9d67fe4502940068aa811ef255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c4ac5cc-d77d-4000-b497-ddc6d13376f0),volume_type_id=0c4ac5cc-d77d-4000-b497-ddc6d13376f0)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beec1b96-171b-427d-9574-40ede37280f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beec1b96-171b-427d-9574-40ede37280f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43afee6-1bc1-4d08-9362-c7bbb536d12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43afee6-1bc1-4d08-9362-c7bbb536d12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94903123-9984-4612-a4ca-e48c8a924b7a', 'volume_name': 'volume-94903123-9984-4612-a4ca-e48c8a924b7a', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087429de-1528-4a3e-a5ee-50806ded7ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087429de-1528-4a3e-a5ee-50806ded7ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1725bec-da4b-4ddf-be71-529fdc90edce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:33 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Volume 94903123-9984-4612-a4ca-e48c8a924b7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94903123-9984-4612-a4ca-e48c8a924b7a', 'volume_size': 1} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e709f332-6a25-429a-a882-cec29e4e0c42,created_at=2026-11-06T09:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858051779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e709f332-6a25-429a-a882-cec29e4e0c42,host='devstack@QuobyteHD#QuobyteHD',id=94903123-9984-4612-a4ca-e48c8a924b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb05627d8f24c0a95bd5f0c7e58c303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:45:33Z,use_quota=True,user_id='029cbd9d67fe4502940068aa811ef255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c4ac5cc-d77d-4000-b497-ddc6d13376f0),volume_type_id=0c4ac5cc-d77d-4000-b497-ddc6d13376f0)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Creating volume 94903123-9984-4612-a4ca-e48c8a924b7a {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:45:33 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:45:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94903123-9984-4612-a4ca-e48c8a924b7a 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:33 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94903123-9984-4612-a4ca-e48c8a924b7a 1073741824 Nov 06 10:45:33 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:34 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94903123-9984-4612-a4ca-e48c8a924b7a 1073741824" returned: 0 in 0.982s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94903123-9984-4612-a4ca-e48c8a924b7a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:34 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94903123-9984-4612-a4ca-e48c8a924b7a Nov 06 10:45:34 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ec383007-8425-4e32-923f-94b8797bde8e tempest-VolumesActionsTest-685125030 None] Acquiring lock "cinder-e0bde55a-bde8-42e5-8f7e-173c98c5f961" by "attach_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:45:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ec383007-8425-4e32-923f-94b8797bde8e tempest-VolumesActionsTest-685125030 None] Lock "cinder-e0bde55a-bde8-42e5-8f7e-173c98c5f961" acquired by "attach_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:45:34 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ec383007-8425-4e32-923f-94b8797bde8e tempest-VolumesActionsTest-685125030 None] Attaching volume e0bde55a-bde8-42e5-8f7e-173c98c5f961 to instance 4a5900e6-0f7a-4d24-8364-91532b23ef11 at mountpoint /dev/vdb on host None. Nov 06 10:45:34 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94903123-9984-4612-a4ca-e48c8a924b7a" returned: 0 in 0.334s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:45:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1725bec-da4b-4ddf-be71-529fdc90edce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94903123-9984-4612-a4ca-e48c8a924b7a', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77587ca-6d4d-4445-b315-4266eff3a736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:34 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ec383007-8425-4e32-923f-94b8797bde8e tempest-VolumesActionsTest-685125030 None] Attach volume completed successfully. Nov 06 10:45:34 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Volume volume-94903123-9984-4612-a4ca-e48c8a924b7a (94903123-9984-4612-a4ca-e48c8a924b7a): created successfully Nov 06 10:45:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77587ca-6d4d-4445-b315-4266eff3a736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Flow 'volume_create_manager' (10090808-a385-404e-965b-cf139222d520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:45:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ec383007-8425-4e32-923f-94b8797bde8e tempest-VolumesActionsTest-685125030 None] Lock "cinder-e0bde55a-bde8-42e5-8f7e-173c98c5f961" released by "attach_volume" :: held 0.161s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:45:34 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a63251ac-b5e6-4f0e-8d87-c954488a3abd tempest-GroupsTest-670453874 None] Created volume successfully. Nov 06 10:45:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5374f0a1-47b4-4a45-8333-761878f4f4c6 tempest-VolumesActionsTest-685125030 None] Acquiring lock "cinder-e0bde55a-bde8-42e5-8f7e-173c98c5f961-detach_volume" by "detach_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:45:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5374f0a1-47b4-4a45-8333-761878f4f4c6 tempest-VolumesActionsTest-685125030 None] Lock "cinder-e0bde55a-bde8-42e5-8f7e-173c98c5f961-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:45:35 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5374f0a1-47b4-4a45-8333-761878f4f4c6 tempest-VolumesActionsTest-685125030 None] Detaching volume e0bde55a-bde8-42e5-8f7e-173c98c5f961 from instance 4a5900e6-0f7a-4d24-8364-91532b23ef11. Nov 06 10:45:35 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5374f0a1-47b4-4a45-8333-761878f4f4c6 tempest-VolumesActionsTest-685125030 None] Detach volume completed successfully. Nov 06 10:45:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5374f0a1-47b4-4a45-8333-761878f4f4c6 tempest-VolumesActionsTest-685125030 None] Lock "cinder-e0bde55a-bde8-42e5-8f7e-173c98c5f961-detach_volume" released by "detach_volume" :: held 0.076s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:36 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:45:36 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Acquiring lock "cinder-quobyte-94903123-9984-4612-a4ca-e48c8a924b7a" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Lock "cinder-quobyte-94903123-9984-4612-a4ca-e48c8a924b7a" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7ce4cb-3cd3-4ff1-864c-6fb1726bda95]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94903123-9984-4612-a4ca-e48c8a924b7a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:36 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.544s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 28 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:45:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:45:36 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94903123-9984-4612-a4ca-e48c8a924b7a Nov 06 10:45:36 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:37 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94903123-9984-4612-a4ca-e48c8a924b7a" returned: 0 in 0.448s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94903123-9984-4612-a4ca-e48c8a924b7a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:37 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94903123-9984-4612-a4ca-e48c8a924b7a Nov 06 10:45:37 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:37 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94903123-9984-4612-a4ca-e48c8a924b7a" returned: 0 in 0.311s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Lock "cinder-quobyte-94903123-9984-4612-a4ca-e48c8a924b7a" released by "delete_volume" :: held 0.826s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:45:37 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Created reservations ['587e8139-ffa4-4ea4-9346-9f980dfdf782'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:45:37 devstack cinder-volume[86819]: WARNING cinder.quota [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-388648775 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-388648775, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:45:37 devstack cinder-volume[86819]: WARNING cinder.quota [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-388648775 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-388648775, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:45:37 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Created reservations ['489c8b72-b7fe-4c46-8a2c-db31059daa9e', 'd21ea6b0-c552-42c6-9a39-6b92165ad4de', '9ab5cf7a-00bb-422c-87a0-6ece369542eb', '9c14f8f1-bcba-4155-a7e1-60a7aa1cb66c'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:45:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:45:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:45:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:37 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:45:37 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:38 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.345s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:38 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:45:38 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c961e985-c009-4704-8a9e-21c9464de045 tempest-GroupsTest-670453874 None] Delete group completed successfully. Nov 06 10:45:38 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-7f9b565a-37c5-4f6a-9997-80c53850c063 tempest-GroupsTest-670453874 None] Created reservations ['c9bc4988-21fb-4d81-9d11-9e169ff52066'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:45:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7f9b565a-37c5-4f6a-9997-80c53850c063 tempest-GroupsTest-670453874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7f9b565a-37c5-4f6a-9997-80c53850c063 tempest-GroupsTest-670453874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7f9b565a-37c5-4f6a-9997-80c53850c063 tempest-GroupsTest-670453874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:45:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7f9b565a-37c5-4f6a-9997-80c53850c063 tempest-GroupsTest-670453874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:45:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7f9b565a-37c5-4f6a-9997-80c53850c063 tempest-GroupsTest-670453874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:45:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7f9b565a-37c5-4f6a-9997-80c53850c063 tempest-GroupsTest-670453874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:38 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:45:38 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:38 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7f9b565a-37c5-4f6a-9997-80c53850c063 tempest-GroupsTest-670453874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.273s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:38 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-7f9b565a-37c5-4f6a-9997-80c53850c063 tempest-GroupsTest-670453874 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:45:38 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7f9b565a-37c5-4f6a-9997-80c53850c063 tempest-GroupsTest-670453874 None] Delete group completed successfully. Nov 06 10:45:39 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-996c1332-461e-4992-93a9-854d6f6a35b6 tempest-GroupsTest-670453874 None] Group tempest-GroupsTest-Group-1968908739: creating Nov 06 10:45:39 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-996c1332-461e-4992-93a9-854d6f6a35b6 tempest-GroupsTest-670453874 None] Group tempest-GroupsTest-Group-1968908739: created successfully Nov 06 10:45:39 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-996c1332-461e-4992-93a9-854d6f6a35b6 tempest-GroupsTest-670453874 None] Create group completed successfully. Nov 06 10:45:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:45:40 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a1712e-8932-47d6-8b68-62abfcb844f6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:45:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:40 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 Nov 06 10:45:40 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:41 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961" returned: 0 in 0.449s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2da733-c951-4067-9b6d-e276132dc1be]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:41 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 Nov 06 10:45:41 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Flow 'volume_create_manager' (23c004c8-5342-4a57-aed2-69faf6f08175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04134999-6d50-4d02-b9c6-bc036a82a6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04134999-6d50-4d02-b9c6-bc036a82a6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-694436491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c713f7-c4ec-4deb-bace-318fb0fd5a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e237ba27ca764386a0d034a5877ce7dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:45:41Z,use_quota=True,user_id='daf5e215cea744b6be61251efb991235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e490c1b2-09d7-4f13-9c89-a89ce5e3fb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e490c1b2-09d7-4f13-9c89-a89ce5e3fb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebaa603-9aa4-4aae-9d3b-54c5b46ae07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:41 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebaa603-9aa4-4aae-9d3b-54c5b46ae07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94c713f7-c4ec-4deb-bace-318fb0fd5a86', 'volume_name': 'volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9a1541-12d6-472a-858e-8669c16c5e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9a1541-12d6-472a-858e-8669c16c5e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260a474e-ddd1-44b1-914a-e6d4a3f2dd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:41 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Volume 94c713f7-c4ec-4deb-bace-318fb0fd5a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86', 'volume_size': 1} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961" returned: 0 in 0.572s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.0f0bf388-50f7-4d27-8453-d93205f50805ra0x1d2e.img {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:41 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.0f0bf388-50f7-4d27-8453-d93205f50805ra0x1d2e.img Nov 06 10:45:41 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Flow 'volume_create_manager' (99190e3a-bbff-4fc6-a9ac-69cbce4bf2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aacda04-216b-4c9b-8579-594f31a6e0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aacda04-216b-4c9b-8579-594f31a6e0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289085254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b830cad4-24d4-4d02-a89a-cd4f2bd67799,host='devstack@QuobyteHD#QuobyteHD',id=89b99437-205b-4f99-988c-a5d1969ef7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb05627d8f24c0a95bd5f0c7e58c303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:45:42Z,use_quota=True,user_id='029cbd9d67fe4502940068aa811ef255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5edeb3a1-859b-494a-afaf-8708d85dc20c),volume_type_id=5edeb3a1-859b-494a-afaf-8708d85dc20c)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156bf817-7853-4f51-bd4b-db1fde4660a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156bf817-7853-4f51-bd4b-db1fde4660a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19a9cc7-d7c5-4993-8776-03e0b2365cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19a9cc7-d7c5-4993-8776-03e0b2365cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b99437-205b-4f99-988c-a5d1969ef7b5', 'volume_name': 'volume-89b99437-205b-4f99-988c-a5d1969ef7b5', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabac519-b9cd-4cbc-8474-04686a0665dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabac519-b9cd-4cbc-8474-04686a0665dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9773153-dab6-47a4-bd1d-89e74ac049ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:45:41 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Volume 89b99437-205b-4f99-988c-a5d1969ef7b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b99437-205b-4f99-988c-a5d1969ef7b5', 'volume_size': 1} Nov 06 10:45:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:45:49 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.0f0bf388-50f7-4d27-8453-d93205f50805ra0x1d2e.img" returned: 0 in 7.556s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:49 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8843a1ec-0a95-4864-97e3-61ada05ae372]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:45:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:45:49 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 Nov 06 10:45:49 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:45:49 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Nov 06 10:45:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961" returned: 0 in 0.553s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:45:49 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] Image conversion details: src /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961, size 1024.00 MB, duration 7.56 sec, destination /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.0f0bf388-50f7-4d27-8453-d93205f50805ra0x1d2e.img {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:45:49 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] Converted 1024.00 MB image at 135.51 MB/s Nov 06 10:45:49 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] 0f0bf388-50f7-4d27-8453-d93205f50805 was raw, no need to convert to raw {{(pid=86819) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1180}} Nov 06 10:45:52 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-eff3c257-af69-47ea-86dc-49e611da9cfa req-30374088-86de-4894-98fe-b808dbad4bc9 tempest-AttachVolumeNegativeTest-1480812843 None] Terminate volume connection completed successfully. Nov 06 10:45:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-eff3c257-af69-47ea-86dc-49e611da9cfa req-30374088-86de-4894-98fe-b808dbad4bc9 tempest-AttachVolumeNegativeTest-1480812843 None] Deleting attachment 23fa439b-ae1b-44d6-b83d-fc1f931c3c16. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:46:02 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=56,cinder:SELECT=56,cinder:DELETE=4,cinder:INSERT=10 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:46:02 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=68,cinder:INSERT=13,cinder:UPDATE=55,cinder:DELETE=3 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:46:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.844s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] Uploaded volume to glance image-id: 0f0bf388-50f7-4d27-8453-d93205f50805. {{(pid=86819) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 10:46:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.780s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-694436491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c713f7-c4ec-4deb-bace-318fb0fd5a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e237ba27ca764386a0d034a5877ce7dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:45:41Z,use_quota=True,user_id='daf5e215cea744b6be61251efb991235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:46:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Creating volume 94c713f7-c4ec-4deb-bace-318fb0fd5a86 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:46:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:46:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:46:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:46:13 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:46:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:13 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-6d4a9626-973a-4dfc-83bd-2a8b88690552 tempest-VolumesActionsTest-685125030 None] Copy volume to image completed successfully. Nov 06 10:46:13 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 1073741824 Nov 06 10:46:13 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:13 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 1073741824" returned: 0 in 0.475s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:13 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 Nov 06 10:46:13 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:14 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86" returned: 0 in 0.247s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 32.350s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b830cad4-24d4-4d02-a89a-cd4f2bd67799,created_at=2026-11-06T09:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289085254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b830cad4-24d4-4d02-a89a-cd4f2bd67799,host='devstack@QuobyteHD#QuobyteHD',id=89b99437-205b-4f99-988c-a5d1969ef7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb05627d8f24c0a95bd5f0c7e58c303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:45:42Z,use_quota=True,user_id='029cbd9d67fe4502940068aa811ef255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5edeb3a1-859b-494a-afaf-8708d85dc20c),volume_type_id=5edeb3a1-859b-494a-afaf-8708d85dc20c)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Creating volume 89b99437-205b-4f99-988c-a5d1969ef7b5 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:46:14 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89b99437-205b-4f99-988c-a5d1969ef7b5 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260a474e-ddd1-44b1-914a-e6d4a3f2dd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:14 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89b99437-205b-4f99-988c-a5d1969ef7b5 1073741824 Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12107b88-1bdd-45f4-8531-c546eeb63f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:14 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:14 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Volume volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 (94c713f7-c4ec-4deb-bace-318fb0fd5a86): created successfully Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12107b88-1bdd-45f4-8531-c546eeb63f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Flow 'volume_create_manager' (23c004c8-5342-4a57-aed2-69faf6f08175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:46:14 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-1adb8186-f0ab-4550-9482-412bfc7490a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Created volume successfully. Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:14 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89b99437-205b-4f99-988c-a5d1969ef7b5 1073741824" returned: 0 in 0.573s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89b99437-205b-4f99-988c-a5d1969ef7b5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:14 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89b99437-205b-4f99-988c-a5d1969ef7b5 Nov 06 10:46:14 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:15 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89b99437-205b-4f99-988c-a5d1969ef7b5" returned: 0 in 0.325s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:46:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.473s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9773153-dab6-47a4-bd1d-89e74ac049ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b99437-205b-4f99-988c-a5d1969ef7b5', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1c4f20-9279-4fd6-8086-aef860ff41a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Creating offline snapshot 3d9850e4-c348-4808-8ec7-f2b288f6d831 of volume 94c713f7-c4ec-4deb-bace-318fb0fd5a86 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:46:15 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Volume volume-89b99437-205b-4f99-988c-a5d1969ef7b5 (89b99437-205b-4f99-988c-a5d1969ef7b5): created successfully Nov 06 10:46:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1c4f20-9279-4fd6-8086-aef860ff41a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Flow 'volume_create_manager' (99190e3a-bbff-4fc6-a9ac-69cbce4bf2b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:46:15 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdeb5d0-8d2c-46d5-a110-97bb52567125]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:46:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:15 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-517feddd-0c45-4987-908d-8591955023a7 tempest-GroupsTest-670453874 None] Created volume successfully. Nov 06 10:46:15 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 Nov 06 10:46:15 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:15 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86" returned: 0 in 0.388s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:15 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831 1G Nov 06 10:46:15 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:16 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831 1G" returned: 0 in 0.410s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:16 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831 Nov 06 10:46:16 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:16 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831" returned: 0 in 0.321s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:16 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831 is being set with open permissions: ugo+rw Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:16 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831 Nov 06 10:46:16 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:16 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831" returned: 0 in 0.341s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:16 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.info Nov 06 10:46:16 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Flow 'volume_create_manager' (065481aa-d348-44b1-981b-3114faf3a153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e7e524-8a81-4581-a469-b7a6922a124a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e7e524-8a81-4581-a469-b7a6922a124a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1411329335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b830cad4-24d4-4d02-a89a-cd4f2bd67799,host='devstack@QuobyteHD#QuobyteHD',id=910297aa-417b-469e-87fe-e55c273de4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb05627d8f24c0a95bd5f0c7e58c303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:46:17Z,use_quota=True,user_id='029cbd9d67fe4502940068aa811ef255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5edeb3a1-859b-494a-afaf-8708d85dc20c),volume_type_id=5edeb3a1-859b-494a-afaf-8708d85dc20c)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90a7d0e-7a7f-48f4-ae0f-7d17a187d0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90a7d0e-7a7f-48f4-ae0f-7d17a187d0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9905d4-07be-4374-95d8-3e75023b2d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9905d4-07be-4374-95d8-3e75023b2d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910297aa-417b-469e-87fe-e55c273de4d8', 'volume_name': 'volume-910297aa-417b-469e-87fe-e55c273de4d8', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9106f2b3-c07e-4759-9628-df70ab821b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9106f2b3-c07e-4759-9628-df70ab821b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4b6c62-5dba-4ff4-b169-2a9d57d4b6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:17 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Volume 910297aa-417b-469e-87fe-e55c273de4d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910297aa-417b-469e-87fe-e55c273de4d8', 'volume_size': 1} Nov 06 10:46:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:17 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.info" returned: 0 in 0.310s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:17 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.info is being set with open permissions: ugo+rw Nov 06 10:46:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:17 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.info Nov 06 10:46:17 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:17 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.info" returned: 0 in 0.246s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.887s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:17 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd4cfee-cd0a-487e-aedb-b11d538f00bc]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:46:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:17 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 Nov 06 10:46:17 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:17 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961" returned: 0 in 0.399s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:17 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d90dd5d-f14d-4994-913f-3c534cef6eaf]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:46:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:17 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b30876e5-12aa-4b7a-a719-358825d99f42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Create snapshot completed successfully Nov 06 10:46:17 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 Nov 06 10:46:17 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:18 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961" returned: 0 in 0.409s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.de746b6b-a08f-4aad-ab49-846f98e98dc6i0wr_7y3.img {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:18 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.de746b6b-a08f-4aad-ab49-846f98e98dc6i0wr_7y3.img Nov 06 10:46:18 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Acquiring lock "cinder-3d9850e4-c348-4808-8ec7-f2b288f6d831-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:46:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "cinder-3d9850e4-c348-4808-8ec7-f2b288f6d831-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:46:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Acquiring lock "cinder-quobyte-94c713f7-c4ec-4deb-bace-318fb0fd5a86" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:46:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "cinder-quobyte-94c713f7-c4ec-4deb-bace-318fb0fd5a86" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:46:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Acquiring lock "cinder-quobyte-3d9850e4-c348-4808-8ec7-f2b288f6d831" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:46:20 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "cinder-quobyte-3d9850e4-c348-4808-8ec7-f2b288f6d831" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:46:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Deleting offline snapshot 3d9850e4-c348-4808-8ec7-f2b288f6d831 of volume 94c713f7-c4ec-4deb-bace-318fb0fd5a86 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:46:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] snapshot_file for this snap is: volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:46:20 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[329c6d9e-6b53-4190-85fc-56fcd5cfd9ff]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:46:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:20 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831 Nov 06 10:46:20 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:21 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831" returned: 0 in 0.981s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:46:21 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33fcf17-4f73-4246-b3b1-ea05f9c92cbb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:46:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:21 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 Nov 06 10:46:21 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:21 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86" returned: 0 in 0.677s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:21 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831 Nov 06 10:46:21 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:22 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831" returned: 0 in 0.820s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:22 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831 Nov 06 10:46:22 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:23 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86.3d9850e4-c348-4808-8ec7-f2b288f6d831" returned: 0 in 0.342s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "cinder-quobyte-3d9850e4-c348-4808-8ec7-f2b288f6d831" released by "_delete_snapshot" :: held 3.100s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:46:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "cinder-quobyte-94c713f7-c4ec-4deb-bace-318fb0fd5a86" released by "delete_snapshot" :: held 3.162s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:46:23 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Created reservations ['7578b307-d4df-4033-8484-9f6e57aa7b58', '15def88b-98f1-43e2-8cfe-57a0e5115590', 'f588c7d3-cb06-4f3f-ad3e-7c9f65517d0a', '2dc9dbcb-1171-486d-a481-eb4e1a56a157'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:46:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Delete snapshot completed successfully. Nov 06 10:46:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-aa07cfbb-9136-451b-bf20-44ff59e188b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "cinder-3d9850e4-c348-4808-8ec7-f2b288f6d831-delete_snapshot" released by "delete_snapshot" :: held 3.498s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:46:24 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Acquiring lock "cinder-94c713f7-c4ec-4deb-bace-318fb0fd5a86-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:46:24 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "cinder-94c713f7-c4ec-4deb-bace-318fb0fd5a86-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:46:24 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Acquiring lock "cinder-quobyte-94c713f7-c4ec-4deb-bace-318fb0fd5a86" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:46:24 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "cinder-quobyte-94c713f7-c4ec-4deb-bace-318fb0fd5a86" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:46:24 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f735ee43-42b0-425f-8c62-7cb179957027]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:46:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:24 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 Nov 06 10:46:24 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:25 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86" returned: 0 in 0.696s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:25 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.de746b6b-a08f-4aad-ab49-846f98e98dc6i0wr_7y3.img" returned: 0 in 7.055s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:25 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86 Nov 06 10:46:25 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a37995-68ca-40ff-b5ef-6f70b19780e7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:25 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 Nov 06 10:46:25 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:25 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94c713f7-c4ec-4deb-bace-318fb0fd5a86" returned: 0 in 0.260s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "cinder-quobyte-94c713f7-c4ec-4deb-bace-318fb0fd5a86" released by "delete_volume" :: held 1.075s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Created reservations ['e9b7a87b-b1d2-4abc-8739-97f9e804170f', '0641ab39-ae55-465d-b902-af324156aebc', '3c4191ba-738c-426b-9d4f-0ab8fbce3c63', '3bc9cec2-6bb7-45e1-8b19-4f5699ee125b'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:25 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:46:25 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:25 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961" returned: 0 in 0.537s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Image conversion details: src /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961, size 1024.00 MB, duration 7.06 sec, destination /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.de746b6b-a08f-4aad-ab49-846f98e98dc6i0wr_7y3.img {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:46:25 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Converted 1024.00 MB image at 145.10 MB/s Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] de746b6b-a08f-4aad-ab49-846f98e98dc6 was raw, converting to qcow2 {{(pid=86819) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1197}} Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[719ab5ad-e5a8-4cd5-8474-ae910ff093d4]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.de746b6b-a08f-4aad-ab49-846f98e98dc6i0wr_7y3.img {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:25 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.260s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:46:25 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Deleted volume successfully. Nov 06 10:46:25 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8b8c8798-3190-4a20-abb6-dd431241c035 tempest-VolumeSnapshotQuotasNegativeTestJSON-1515026952 None] Lock "cinder-94c713f7-c4ec-4deb-bace-318fb0fd5a86-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:46:25 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.de746b6b-a08f-4aad-ab49-846f98e98dc6i0wr_7y3.img Nov 06 10:46:25 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:26 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.de746b6b-a08f-4aad-ab49-846f98e98dc6i0wr_7y3.img" returned: 0 in 0.318s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.de746b6b-a08f-4aad-ab49-846f98e98dc6i0wr_7y3.img {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:26 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.de746b6b-a08f-4aad-ab49-846f98e98dc6i0wr_7y3.img Nov 06 10:46:26 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:26 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.de746b6b-a08f-4aad-ab49-846f98e98dc6i0wr_7y3.img" returned: 1 in 0.323s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.de746b6b-a08f-4aad-ab49-846f98e98dc6i0wr_7y3.img' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:46:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.de746b6b-a08f-4aad-ab49-846f98e98dc6i0wr_7y3.img /opt/stack/data/cinder/conversion/vol_upload_as2bkqvr {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:26 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.de746b6b-a08f-4aad-ab49-846f98e98dc6i0wr_7y3.img /opt/stack/data/cinder/conversion/vol_upload_as2bkqvr Nov 06 10:46:26 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:26 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.de746b6b-a08f-4aad-ab49-846f98e98dc6i0wr_7y3.img /opt/stack/data/cinder/conversion/vol_upload_as2bkqvr" returned: 0 in 0.312s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:26 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Image conversion details: src /opt/stack/data/cinder/conversion/e0bde55a-bde8-42e5-8f7e-173c98c5f961.temp_image.de746b6b-a08f-4aad-ab49-846f98e98dc6i0wr_7y3.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_as2bkqvr {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:46:26 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 06 10:46:26 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae583177-1063-4674-9150-b940a019d200]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:46:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_as2bkqvr {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:26 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_as2bkqvr Nov 06 10:46:26 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:27 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_as2bkqvr" returned: 0 in 0.402s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.480s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Uploaded volume to glance image-id: de746b6b-a08f-4aad-ab49-846f98e98dc6. {{(pid=86819) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 10:46:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.834s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b830cad4-24d4-4d02-a89a-cd4f2bd67799,created_at=2026-11-06T09:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1411329335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b830cad4-24d4-4d02-a89a-cd4f2bd67799,host='devstack@QuobyteHD#QuobyteHD',id=910297aa-417b-469e-87fe-e55c273de4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb05627d8f24c0a95bd5f0c7e58c303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:46:17Z,use_quota=True,user_id='029cbd9d67fe4502940068aa811ef255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5edeb3a1-859b-494a-afaf-8708d85dc20c),volume_type_id=5edeb3a1-859b-494a-afaf-8708d85dc20c)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:46:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Creating volume 910297aa-417b-469e-87fe-e55c273de4d8 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:46:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:46:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:46:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:46:28 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:46:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-910297aa-417b-469e-87fe-e55c273de4d8 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:28 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-910297aa-417b-469e-87fe-e55c273de4d8 1073741824 Nov 06 10:46:28 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:28 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d13dd2c0-5294-4175-8e38-ed437fe27b60 tempest-VolumesActionsTest-685125030 None] Copy volume to image completed successfully. Nov 06 10:46:29 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-910297aa-417b-469e-87fe-e55c273de4d8 1073741824" returned: 0 in 0.548s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-910297aa-417b-469e-87fe-e55c273de4d8 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:29 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-910297aa-417b-469e-87fe-e55c273de4d8 Nov 06 10:46:29 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:29 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-910297aa-417b-469e-87fe-e55c273de4d8" returned: 0 in 0.304s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:46:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4b6c62-5dba-4ff4-b169-2a9d57d4b6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910297aa-417b-469e-87fe-e55c273de4d8', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7dd53a7-a85f-4e2f-be39-789bece1c093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:29 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Volume volume-910297aa-417b-469e-87fe-e55c273de4d8 (910297aa-417b-469e-87fe-e55c273de4d8): created successfully Nov 06 10:46:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7dd53a7-a85f-4e2f-be39-789bece1c093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Flow 'volume_create_manager' (065481aa-d348-44b1-981b-3114faf3a153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:46:29 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-0f3d60dd-1422-488d-a7eb-4ce7eefa2a1f tempest-GroupsTest-670453874 None] Created volume successfully. Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Acquiring lock "cinder-e0bde55a-bde8-42e5-8f7e-173c98c5f961-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Lock "cinder-e0bde55a-bde8-42e5-8f7e-173c98c5f961-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Acquiring lock "cinder-quobyte-e0bde55a-bde8-42e5-8f7e-173c98c5f961" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Lock "cinder-quobyte-e0bde55a-bde8-42e5-8f7e-173c98c5f961" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26903e4-00e0-46a3-a23b-48bcf0cfc45b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:30 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 Nov 06 10:46:30 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:30 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961" returned: 0 in 0.374s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:30 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961 Nov 06 10:46:30 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-491b285f-76d3-4dc1-b2c9-ea8ba96a2beb tempest-GroupsTest-670453874 None] Update group completed successfully. Nov 06 10:46:30 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e0bde55a-bde8-42e5-8f7e-173c98c5f961" returned: 0 in 0.282s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Lock "cinder-quobyte-e0bde55a-bde8-42e5-8f7e-173c98c5f961" released by "delete_volume" :: held 0.706s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Created reservations ['853d860e-99ee-4b75-82bc-710862ead06d', 'e54134a2-d123-442b-a7bb-7a64ed1a8276', '593fc5c4-a8d0-4fef-8270-d21e49c231bd', 'a5ec3c0c-f050-4519-bb8c-5f1c8783df9d'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:30 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:46:30 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:31 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.315s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:46:31 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Deleted volume successfully. Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-18588e88-6a6e-4db6-8f5b-3c907c19a788 tempest-VolumesActionsTest-685125030 None] Lock "cinder-e0bde55a-bde8-42e5-8f7e-173c98c5f961-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Flow 'volume_create_manager' (6962afd6-1432-4ccb-84f3-aaf5bd872a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f387f029-a5fe-4666-9eab-ca7da18402ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f387f029-a5fe-4666-9eab-ca7da18402ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1259614183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461fa7f7-d0af-4cd7-a316-c5d47b67c249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a0c02fdac44d793b586450ce5a515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:46:31Z,use_quota=True,user_id='4dd5b0cbf7d34e44aeaaccde209a98b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23cb169d-c287-49f7-ab32-75f02725eea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23cb169d-c287-49f7-ab32-75f02725eea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917f5743-81ed-45a2-8f80-90614de804d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917f5743-81ed-45a2-8f80-90614de804d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '461fa7f7-d0af-4cd7-a316-c5d47b67c249', 'volume_name': 'volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04009a1a-7324-4f62-a05a-39fab65126a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04009a1a-7324-4f62-a05a-39fab65126a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ab2322-f886-4407-80e2-a144fd31962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:31 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Volume 461fa7f7-d0af-4cd7-a316-c5d47b67c249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249', 'volume_size': 1} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1259614183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461fa7f7-d0af-4cd7-a316-c5d47b67c249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a0c02fdac44d793b586450ce5a515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:46:31Z,use_quota=True,user_id='4dd5b0cbf7d34e44aeaaccde209a98b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Creating volume 461fa7f7-d0af-4cd7-a316-c5d47b67c249 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:46:31 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:46:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:31 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249 1073741824 Nov 06 10:46:31 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:32 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249 1073741824" returned: 0 in 0.688s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:32 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b08872b9-2a55-459d-8e7b-3853120de4c5 tempest-GroupsTest-670453874 None] Update group completed successfully. Nov 06 10:46:32 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249 Nov 06 10:46:32 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:32 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249" returned: 0 in 0.267s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:46:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ab2322-f886-4407-80e2-a144fd31962c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4535fe38-9836-45e1-a32c-7a3a3197e427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:32 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Volume volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249 (461fa7f7-d0af-4cd7-a316-c5d47b67c249): created successfully Nov 06 10:46:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4535fe38-9836-45e1-a32c-7a3a3197e427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Flow 'volume_create_manager' (6962afd6-1432-4ccb-84f3-aaf5bd872a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:46:32 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9d823dca-3923-4f02-b433-25a12781be19 tempest-AttachVolumeNegativeTest-1480812843 None] Created volume successfully. Nov 06 10:46:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Acquiring lock "cinder-quobyte-89b99437-205b-4f99-988c-a5d1969ef7b5" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:46:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Lock "cinder-quobyte-89b99437-205b-4f99-988c-a5d1969ef7b5" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:46:34 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eecac27-b24a-4374-978d-e8be98c69675]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:46:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89b99437-205b-4f99-988c-a5d1969ef7b5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:34 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89b99437-205b-4f99-988c-a5d1969ef7b5 Nov 06 10:46:34 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-add6f4c6-2bc5-468d-ac8f-232d1c3c86c5 req-f3118d12-24a0-44a4-afcd-0f8326e0f20d tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-add6f4c6-2bc5-468d-ac8f-232d1c3c86c5 req-f3118d12-24a0-44a4-afcd-0f8326e0f20d tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-add6f4c6-2bc5-468d-ac8f-232d1c3c86c5 req-f3118d12-24a0-44a4-afcd-0f8326e0f20d tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-add6f4c6-2bc5-468d-ac8f-232d1c3c86c5 req-f3118d12-24a0-44a4-afcd-0f8326e0f20d tempest-AttachVolumeNegativeTest-1480812843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '416f657b-8b39-4c3c-86ac-a5d5c81fabef', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:46:34 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-add6f4c6-2bc5-468d-ac8f-232d1c3c86c5 req-f3118d12-24a0-44a4-afcd-0f8326e0f20d tempest-AttachVolumeNegativeTest-1480812843 None] attachment_update completed successfully. Nov 06 10:46:34 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89b99437-205b-4f99-988c-a5d1969ef7b5" returned: 0 in 0.417s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89b99437-205b-4f99-988c-a5d1969ef7b5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:34 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89b99437-205b-4f99-988c-a5d1969ef7b5 Nov 06 10:46:34 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:35 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89b99437-205b-4f99-988c-a5d1969ef7b5" returned: 0 in 0.425s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Lock "cinder-quobyte-89b99437-205b-4f99-988c-a5d1969ef7b5" released by "delete_volume" :: held 0.899s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:46:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Acquiring lock "cinder-quobyte-910297aa-417b-469e-87fe-e55c273de4d8" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:46:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Lock "cinder-quobyte-910297aa-417b-469e-87fe-e55c273de4d8" acquired by "delete_volume" :: waited 0.041s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:46:35 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ac3d30-8215-4c9e-a377-25e4847ff436]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:46:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-910297aa-417b-469e-87fe-e55c273de4d8 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:35 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-910297aa-417b-469e-87fe-e55c273de4d8 Nov 06 10:46:35 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:35 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-910297aa-417b-469e-87fe-e55c273de4d8" returned: 0 in 0.582s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-910297aa-417b-469e-87fe-e55c273de4d8 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:35 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-910297aa-417b-469e-87fe-e55c273de4d8 Nov 06 10:46:35 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:36 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:46:36 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:36 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-910297aa-417b-469e-87fe-e55c273de4d8" returned: 0 in 0.311s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Lock "cinder-quobyte-910297aa-417b-469e-87fe-e55c273de4d8" released by "delete_volume" :: held 0.966s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Created reservations ['10a62c39-0e95-4dea-9502-6ea12148cd50'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:46:36 devstack cinder-volume[86819]: WARNING cinder.quota [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-879719616 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-879719616, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:46:36 devstack cinder-volume[86819]: WARNING cinder.quota [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-879719616 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-879719616, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Created reservations ['af7e38c9-b880-48dd-80d7-dadb237d69b1', '6016b320-07ab-4291-9c3d-096f063ecce9', 'b7e5006e-3492-402d-a9a2-e62c7a8a50d8', 'df5b4517-0a52-4bff-8152-c2ad3d922578'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:46:36 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.472s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 28 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Created reservations ['e79f0598-1a12-43d2-9d2a-b86d938bb912', '2fa3b360-dacd-4e00-8a8b-49152ed2bf34', 'c57de6b0-bcea-43ba-b142-e49c1c4a05fc', '87a960ff-c184-473a-a6a0-6690a562e087'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:36 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:46:36 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:37 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.479s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:37 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:46:37 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-eded22f7-411b-4bcc-893b-dcdb11498e23 tempest-GroupsTest-670453874 None] Delete group completed successfully. Nov 06 10:46:38 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-ebf18c30-92d8-4d2a-8b80-e77ba83d9cb6 req-c144b50d-aace-4cf5-be95-5216457f011c tempest-AttachVolumeNegativeTest-1480812843 None] Terminate volume connection completed successfully. Nov 06 10:46:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-ebf18c30-92d8-4d2a-8b80-e77ba83d9cb6 req-c144b50d-aace-4cf5-be95-5216457f011c tempest-AttachVolumeNegativeTest-1480812843 None] Deleting attachment 416f657b-8b39-4c3c-86ac-a5d5c81fabef. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Flow 'volume_create_manager' (d243ec1c-7584-436d-aece-9b7b7f6e565c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590d40ef-a15a-4b27-89be-c2610ab0cb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590d40ef-a15a-4b27-89be-c2610ab0cb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-735074671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88b7ea5-b901-4bed-a567-8ca688807aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df1bb5beb2304d5f9525a856fb95ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:46:42Z,use_quota=True,user_id='545a64b1184a40e6aea98c37d5a77716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471411e8-6b8a-4762-b55d-8a76997b0281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471411e8-6b8a-4762-b55d-8a76997b0281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c06101f-9d17-4b84-8a1e-9e2dd1710f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c06101f-9d17-4b84-8a1e-9e2dd1710f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b88b7ea5-b901-4bed-a567-8ca688807aca', 'volume_name': 'volume-b88b7ea5-b901-4bed-a567-8ca688807aca', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a674df26-9234-4c9a-a170-f5946ca40dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a674df26-9234-4c9a-a170-f5946ca40dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed088c3-f068-4bcd-8090-d170ad46f32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:42 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Volume b88b7ea5-b901-4bed-a567-8ca688807aca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b88b7ea5-b901-4bed-a567-8ca688807aca', 'volume_size': 1} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-735074671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88b7ea5-b901-4bed-a567-8ca688807aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df1bb5beb2304d5f9525a856fb95ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:46:42Z,use_quota=True,user_id='545a64b1184a40e6aea98c37d5a77716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Creating volume b88b7ea5-b901-4bed-a567-8ca688807aca {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:46:42 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:46:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:42 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca 1073741824 Nov 06 10:46:42 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:43 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca 1073741824" returned: 0 in 0.613s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:43 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca Nov 06 10:46:43 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:43 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca" returned: 0 in 0.306s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:46:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed088c3-f068-4bcd-8090-d170ad46f32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88b7ea5-b901-4bed-a567-8ca688807aca', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b1360b-88fa-44e6-ae6c-25cd2ab6b2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:43 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Volume volume-b88b7ea5-b901-4bed-a567-8ca688807aca (b88b7ea5-b901-4bed-a567-8ca688807aca): created successfully Nov 06 10:46:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b1360b-88fa-44e6-ae6c-25cd2ab6b2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Flow 'volume_create_manager' (d243ec1c-7584-436d-aece-9b7b7f6e565c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:46:43 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-4f935c52-00c8-43cb-a10f-c7aa47773672 tempest-VolumesCloneTest-106231443 None] Created volume successfully. Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Flow 'volume_create_manager' (ff0f421b-d665-441b-88c9-fc4e62204eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f470eb-fcd5-4e50-9ff8-88accb82a59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f470eb-fcd5-4e50-9ff8-88accb82a59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2470536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1901c22e-fb3f-46c0-8bdd-6ee9d01d0223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df1bb5beb2304d5f9525a856fb95ed52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:46:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b88b7ea5-b901-4bed-a567-8ca688807aca,status='creating',terminated_at=None,updated_at=2026-11-06T09:46:45Z,use_quota=True,user_id='545a64b1184a40e6aea98c37d5a77716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4008f9-c25e-4bcf-858c-cfeb1ddcf7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4008f9-c25e-4bcf-858c-cfeb1ddcf7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45723c6-5148-49dc-8786-0d1d782113bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45723c6-5148-49dc-8786-0d1d782113bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1901c22e-fb3f-46c0-8bdd-6ee9d01d0223', 'volume_name': 'volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223', 'volume_size': 2, 'source_volid': 'b88b7ea5-b901-4bed-a567-8ca688807aca', 'source_volstatus': 'available'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924e9467-3310-41b1-8bb8-311cb223732d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924e9467-3310-41b1-8bb8-311cb223732d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26052303-183b-4c0d-91a4-eb5c39caaf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:45 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Volume 1901c22e-fb3f-46c0-8bdd-6ee9d01d0223: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223', 'volume_size': 2, 'source_volid': 'b88b7ea5-b901-4bed-a567-8ca688807aca', 'source_volstatus': 'available'} Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:45 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Cloning volume b88b7ea5-b901-4bed-a567-8ca688807aca to volume 1901c22e-fb3f-46c0-8bdd-6ee9d01d0223 Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Creating offline snapshot f2c305d9-544a-4df9-8833-3b34bd85a8bd of volume b88b7ea5-b901-4bed-a567-8ca688807aca {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd59636f-8572-462d-b744-35b2d26c9fc3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:45 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca Nov 06 10:46:45 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:45 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca" returned: 0 in 0.464s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:45 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd 1G Nov 06 10:46:45 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:46 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd 1G" returned: 0 in 0.590s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b88b7ea5-b901-4bed-a567-8ca688807aca -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:46 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b88b7ea5-b901-4bed-a567-8ca688807aca -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd Nov 06 10:46:46 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:46 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:46:46 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Flow 'volume_create_manager' (5bdc3102-9348-4e3d-96c2-c097284ec98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:46:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5baac806-ec72-443e-865a-fa2bf98b38c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b88b7ea5-b901-4bed-a567-8ca688807aca -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd" returned: 0 in 0.503s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:46 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd is being set with open permissions: ugo+rw Nov 06 10:46:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5baac806-ec72-443e-865a-fa2bf98b38c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-639817886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b687d4b7-7a6e-4738-9f60-093c270e81dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4f772673e94eea9f61f136113062bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:46:47Z,use_quota=True,user_id='b24af9fbbfc94680a33e7f712e122f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4395b0-b4a4-470a-b330-6cfbc0500788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4395b0-b4a4-470a-b330-6cfbc0500788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46232c55-dd88-4975-9963-bafbda685f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46232c55-dd88-4975-9963-bafbda685f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b687d4b7-7a6e-4738-9f60-093c270e81dd', 'volume_name': 'volume-b687d4b7-7a6e-4738-9f60-093c270e81dd', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580ec664-b77b-474d-84d1-6f9e6976a9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:47 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd Nov 06 10:46:47 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580ec664-b77b-474d-84d1-6f9e6976a9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bc2359-bfd2-46c6-be1d-11d3bd7104a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:47 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Volume b687d4b7-7a6e-4738-9f60-093c270e81dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b687d4b7-7a6e-4738-9f60-093c270e81dd', 'volume_size': 1} Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:47 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd" returned: 0 in 0.334s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:47 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.info Nov 06 10:46:47 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:47 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.info" returned: 0 in 0.316s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:47 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.info is being set with open permissions: ugo+rw Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:47 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.info Nov 06 10:46:47 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:47 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.info" returned: 0 in 0.294s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Acquiring lock "cinder-quobyte-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223" by "_copy_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Lock "cinder-quobyte-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:46:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] snapshot: f2c305d9-544a-4df9-8833-3b34bd85a8bd, volume: 1901c22e-fb3f-46c0-8bdd-6ee9d01d0223, {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 10:46:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:46:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:46:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:46:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:46:48 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c822d1a-b359-44e0-90a2-c57a7c662211]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:46:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:48 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd Nov 06 10:46:48 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:48 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd" returned: 0 in 0.546s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b88b7ea5-b901-4bed-a567-8ca688807aca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:46:48 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[705e9ea9-e6fd-4779-a861-8fb9f2b53609]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:46:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:48 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca Nov 06 10:46:48 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:49 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca" returned: 0 in 0.501s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] will copy from snapshot at /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 10:46:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Creating direct copy from snapshot {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 10:46:49 devstack cinder-volume[86819]: DEBUG cinder.utils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Path /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223 not found in is_blk_device check {{(pid=86819) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 10:46:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:46:49 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223 Nov 06 10:46:49 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:46:57 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=59,cinder:UPDATE=68,cinder:DELETE=3,cinder:INSERT=13 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:46:57 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=56,cinder:SELECT=60,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:46:59 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:46:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Flow 'volume_create_manager' (4932de3f-40d4-42eb-9078-2aadd0a37566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:46:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4ade17-2dc5-4ad4-8729-b9d95a355dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4ade17-2dc5-4ad4-8729-b9d95a355dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-846799024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b5ff92-1c99-411b-a307-587587daa396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58831ded391e47c8a557b3279aa33f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:46:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:46:59Z,use_quota=True,user_id='3b80712072f94fe8b06b099851998737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24f204e-de7a-4957-b649-4ce1f11468b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24f204e-de7a-4957-b649-4ce1f11468b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878ca409-4ca4-4261-99e9-069b07abd90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878ca409-4ca4-4261-99e9-069b07abd90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94b5ff92-1c99-411b-a307-587587daa396', 'volume_name': 'volume-94b5ff92-1c99-411b-a307-587587daa396', 'volume_size': 2}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ef5470-f409-4857-9f13-78692d1642e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ef5470-f409-4857-9f13-78692d1642e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:46:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67869bf5-152b-40d2-a37a-c001598f6b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:46:59 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Volume 94b5ff92-1c99-411b-a307-587587daa396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94b5ff92-1c99-411b-a307-587587daa396', 'volume_size': 2} Nov 06 10:46:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:46:59 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Nov 06 10:46:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223" returned: 0 in 10.844s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:46:59 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Image conversion details: src /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca, size 1024.00 MB, duration 10.85 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223 {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:46:59 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Converted 1024.00 MB image at 94.42 MB/s Nov 06 10:46:59 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223 is being set with open permissions: ugo+rw Nov 06 10:46:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:00 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223 Nov 06 10:47:00 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:00 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223" returned: 0 in 0.239s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Lock "cinder-quobyte-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223" released by "_copy_volume_from_snapshot" :: held 12.253s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Acquiring lock "cinder-quobyte-f2c305d9-544a-4df9-8833-3b34bd85a8bd" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Lock "cinder-quobyte-f2c305d9-544a-4df9-8833-3b34bd85a8bd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Deleting offline snapshot f2c305d9-544a-4df9-8833-3b34bd85a8bd of volume b88b7ea5-b901-4bed-a567-8ca688807aca {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:47:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] snapshot_file for this snap is: volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:47:00 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c60aad-3662-4113-b402-c1fb3af12a45]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:00 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd Nov 06 10:47:00 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:00 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd" returned: 0 in 0.456s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b88b7ea5-b901-4bed-a567-8ca688807aca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:00 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[6039416d-3427-4b48-b9b9-b97c48b5509c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:00 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca Nov 06 10:47:00 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:01 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca" returned: 0 in 0.596s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:01 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd Nov 06 10:47:01 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:01 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd" returned: 0 in 0.377s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:01 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd Nov 06 10:47:01 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:02 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca.f2c305d9-544a-4df9-8833-3b34bd85a8bd" returned: 0 in 0.291s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Lock "cinder-quobyte-f2c305d9-544a-4df9-8833-3b34bd85a8bd" released by "_delete_snapshot" :: held 1.850s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.836s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.141s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-639817886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b687d4b7-7a6e-4738-9f60-093c270e81dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4f772673e94eea9f61f136113062bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:46:47Z,use_quota=True,user_id='b24af9fbbfc94680a33e7f712e122f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Creating volume b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:47:02 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26052303-183b-4c0d-91a4-eb5c39caaf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223', 'volume_size': 2, 'source_volid': 'b88b7ea5-b901-4bed-a567-8ca688807aca', 'source_volstatus': 'available'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:02 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd 1073741824 Nov 06 10:47:02 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c801f00-0c06-4104-b97a-9497d18bf554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:02 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Volume volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223 (1901c22e-fb3f-46c0-8bdd-6ee9d01d0223): created successfully Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c801f00-0c06-4104-b97a-9497d18bf554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Flow 'volume_create_manager' (ff0f421b-d665-441b-88c9-fc4e62204eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:02 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-1e6876ca-1d0f-4c90-9767-3d2382998e16 tempest-VolumesCloneTest-106231443 None] Created volume successfully. Nov 06 10:47:02 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd 1073741824" returned: 0 in 0.424s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:02 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd Nov 06 10:47:02 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:02 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd" returned: 0 in 0.250s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.671s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-846799024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b5ff92-1c99-411b-a307-587587daa396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58831ded391e47c8a557b3279aa33f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:46:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:46:59Z,use_quota=True,user_id='3b80712072f94fe8b06b099851998737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Creating volume 94b5ff92-1c99-411b-a307-587587daa396 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:47:02 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94b5ff92-1c99-411b-a307-587587daa396 2147483648 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bc2359-bfd2-46c6-be1d-11d3bd7104a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b687d4b7-7a6e-4738-9f60-093c270e81dd', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121ffd3b-4c1c-4f9e-b0c4-7aaac7841492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:02 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94b5ff92-1c99-411b-a307-587587daa396 2147483648 Nov 06 10:47:02 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:02 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Volume volume-b687d4b7-7a6e-4738-9f60-093c270e81dd (b687d4b7-7a6e-4738-9f60-093c270e81dd): created successfully Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121ffd3b-4c1c-4f9e-b0c4-7aaac7841492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Flow 'volume_create_manager' (5bdc3102-9348-4e3d-96c2-c097284ec98b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:03 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-6345cbe3-19ee-4bb2-8add-c9897cc44d83 tempest-SnapshotsActionsTest-2134058876 None] Created volume successfully. Nov 06 10:47:03 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94b5ff92-1c99-411b-a307-587587daa396 2147483648" returned: 0 in 0.541s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94b5ff92-1c99-411b-a307-587587daa396 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:03 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94b5ff92-1c99-411b-a307-587587daa396 Nov 06 10:47:03 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Acquiring lock "cinder-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Lock "cinder-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Acquiring lock "cinder-quobyte-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Lock "cinder-quobyte-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223" acquired by "delete_volume" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:03 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5840bc-a5c5-4402-a0ca-e7ecc75dd72f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:03 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94b5ff92-1c99-411b-a307-587587daa396" returned: 0 in 0.361s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:47:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67869bf5-152b-40d2-a37a-c001598f6b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94b5ff92-1c99-411b-a307-587587daa396', 'volume_size': 2}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05fb63f9-aaa8-4f63-a812-78e0fc15a8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:03 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Volume volume-94b5ff92-1c99-411b-a307-587587daa396 (94b5ff92-1c99-411b-a307-587587daa396): created successfully Nov 06 10:47:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05fb63f9-aaa8-4f63-a812-78e0fc15a8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Flow 'volume_create_manager' (4932de3f-40d4-42eb-9078-2aadd0a37566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:03 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-66cc72ad-435b-420e-95db-02e31785db0d tempest-VolumesCloneNegativeTest-169669161 None] Created volume successfully. Nov 06 10:47:03 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223 Nov 06 10:47:03 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] Creating offline snapshot ee5bc5dc-33e6-4c37-8b11-ac8644804535 of volume b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a1bac4-6618-44e6-a1dd-cc7a574c0a0a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:04 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd Nov 06 10:47:04 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:04 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Acquiring lock "cinder-94b5ff92-1c99-411b-a307-587587daa396-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223" returned: 0 in 0.556s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Lock "cinder-94b5ff92-1c99-411b-a307-587587daa396-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:04 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223 Nov 06 10:47:04 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Acquiring lock "cinder-quobyte-94b5ff92-1c99-411b-a307-587587daa396" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Lock "cinder-quobyte-94b5ff92-1c99-411b-a307-587587daa396" acquired by "delete_volume" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[67484dd2-c673-40fd-a214-d1ef581a3edd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94b5ff92-1c99-411b-a307-587587daa396 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:04 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd" returned: 0 in 0.522s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:04 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94b5ff92-1c99-411b-a307-587587daa396 Nov 06 10:47:04 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:04 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 1G Nov 06 10:47:04 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:04 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223" returned: 0 in 0.387s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Lock "cinder-quobyte-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223" released by "delete_volume" :: held 1.029s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Created reservations ['d9d3b29e-6cbb-40b0-b34c-65f87addee4c', '8ca5af9c-661d-4f3e-85e6-efa5f70d0655', '713aaf97-85ff-4079-b195-06a158838fc0', '2605dc15-8902-4b68-865f-b6baf86b8352'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:05 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:47:05 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:05 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94b5ff92-1c99-411b-a307-587587daa396" returned: 0 in 0.524s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94b5ff92-1c99-411b-a307-587587daa396 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:05 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94b5ff92-1c99-411b-a307-587587daa396 Nov 06 10:47:05 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:05 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 1G" returned: 0 in 0.562s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b687d4b7-7a6e-4738-9f60-093c270e81dd -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:05 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b687d4b7-7a6e-4738-9f60-093c270e81dd -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 Nov 06 10:47:05 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:05 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.330s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:47:05 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Deleted volume successfully. Nov 06 10:47:05 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a9cd9215-fdf8-4378-a67b-8c1e9971a729 tempest-VolumesCloneTest-106231443 None] Lock "cinder-1901c22e-fb3f-46c0-8bdd-6ee9d01d0223-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-94b5ff92-1c99-411b-a307-587587daa396" returned: 0 in 0.318s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Lock "cinder-quobyte-94b5ff92-1c99-411b-a307-587587daa396" released by "delete_volume" :: held 0.893s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Created reservations ['f7715db3-9af7-4300-a92a-d517dff1f40c', 'ca04a845-d700-4f67-9708-c45be6566e65', '2ca2f1de-b329-438a-a717-8377b5f96d04', '17c002fe-b884-445e-b3e0-fd4495fff395'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:05 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b687d4b7-7a6e-4738-9f60-093c270e81dd -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535" returned: 0 in 0.332s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:05 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 is being set with open permissions: ugo+rw Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:05 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:47:05 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:05 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 Nov 06 10:47:05 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:05 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535" returned: 0 in 0.317s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:05 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.371s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:47:05 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Deleted volume successfully. Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ee4b6ee4-474c-4196-8014-8ae285d28779 tempest-VolumesCloneNegativeTest-169669161 None] Lock "cinder-94b5ff92-1c99-411b-a307-587587daa396-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:06 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.info Nov 06 10:47:06 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Acquiring lock "cinder-b88b7ea5-b901-4bed-a567-8ca688807aca-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Lock "cinder-b88b7ea5-b901-4bed-a567-8ca688807aca-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Acquiring lock "cinder-quobyte-b88b7ea5-b901-4bed-a567-8ca688807aca" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Lock "cinder-quobyte-b88b7ea5-b901-4bed-a567-8ca688807aca" acquired by "delete_volume" :: waited 0.035s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:06 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9e8fd2-4f97-45d5-a245-427adabe8c73]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:06 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.info" returned: 0 in 0.428s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:06 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.info is being set with open permissions: ugo+rw Nov 06 10:47:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:06 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.info Nov 06 10:47:06 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:06 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca Nov 06 10:47:06 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:06 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:06 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca" returned: 0 in 0.435s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.info" returned: 0 in 0.365s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:06 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca Nov 06 10:47:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.682s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:06 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:06 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ab96ccdd-a034-47f3-b40a-fd48573c5eed tempest-SnapshotsActionsTest-2134058876 None] Create snapshot completed successfully Nov 06 10:47:07 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b88b7ea5-b901-4bed-a567-8ca688807aca" returned: 0 in 0.327s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Lock "cinder-quobyte-b88b7ea5-b901-4bed-a567-8ca688807aca" released by "delete_volume" :: held 0.839s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:07 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Created reservations ['29765d04-0806-46f6-ad12-145155d1be35', '23c83137-479c-4de7-b98a-25a6b217e355', 'b83abec8-a2a9-49d1-8f64-bee85fcf2387', '10e770bb-68f3-4f31-b4c7-5e6e158514ea'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:07 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:47:07 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:07 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.372s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:07 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:47:07 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Deleted volume successfully. Nov 06 10:47:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-413be406-1efc-4a28-808d-bac3f278b016 tempest-VolumesCloneTest-106231443 None] Lock "cinder-b88b7ea5-b901-4bed-a567-8ca688807aca-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6bdc5cc7-ea7c-430d-817b-8a424efa9b2b tempest-SnapshotsActionsTest-2134058876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6bdc5cc7-ea7c-430d-817b-8a424efa9b2b tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-6bdc5cc7-ea7c-430d-817b-8a424efa9b2b tempest-SnapshotsActionsTest-2134058876 None] Creating offline snapshot f0048fc2-cc88-491f-b76c-6f4a1eb10707 of volume b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:47:08 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69c3a0e-7e89-4b3d-9b91-ce5646723231]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6bdc5cc7-ea7c-430d-817b-8a424efa9b2b tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:08 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 Nov 06 10:47:08 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:08 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6bdc5cc7-ea7c-430d-817b-8a424efa9b2b tempest-SnapshotsActionsTest-2134058876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535" returned: 0 in 0.444s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-6bdc5cc7-ea7c-430d-817b-8a424efa9b2b tempest-SnapshotsActionsTest-2134058876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b687d4b7-7a6e-4738-9f60-093c270e81dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6bdc5cc7-ea7c-430d-817b-8a424efa9b2b tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:08 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707 1G Nov 06 10:47:08 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:09 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6bdc5cc7-ea7c-430d-817b-8a424efa9b2b tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707 1G" returned: 0 in 0.525s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6bdc5cc7-ea7c-430d-817b-8a424efa9b2b tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:09 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707 Nov 06 10:47:09 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:09 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6bdc5cc7-ea7c-430d-817b-8a424efa9b2b tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707" returned: 0 in 0.332s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:09 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-6bdc5cc7-ea7c-430d-817b-8a424efa9b2b tempest-SnapshotsActionsTest-2134058876 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707 is being set with open permissions: ugo+rw Nov 06 10:47:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6bdc5cc7-ea7c-430d-817b-8a424efa9b2b tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:09 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707 Nov 06 10:47:09 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:10 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6bdc5cc7-ea7c-430d-817b-8a424efa9b2b tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707" returned: 0 in 0.274s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6bdc5cc7-ea7c-430d-817b-8a424efa9b2b tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.701s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:10 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-6bdc5cc7-ea7c-430d-817b-8a424efa9b2b tempest-SnapshotsActionsTest-2134058876 None] Create snapshot completed successfully Nov 06 10:47:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Acquiring lock "cinder-f0048fc2-cc88-491f-b76c-6f4a1eb10707-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-f0048fc2-cc88-491f-b76c-6f4a1eb10707-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Acquiring lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Acquiring lock "cinder-quobyte-f0048fc2-cc88-491f-b76c-6f4a1eb10707" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-f0048fc2-cc88-491f-b76c-6f4a1eb10707" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:10 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Deleting offline snapshot f0048fc2-cc88-491f-b76c-6f4a1eb10707 of volume b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:47:10 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] snapshot_file for this snap is: volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:47:10 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce494aa-5a53-4f5b-82c7-c574caf642d2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:10 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707 Nov 06 10:47:10 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Flow 'volume_create_manager' (32625021-80af-46df-a08a-53402b31ab98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe08974-cbdb-4b2e-acf1-af3f43cfe704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe08974-cbdb-4b2e-acf1-af3f43cfe704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1942488511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcd2ff4-09f5-4592-9517-e0af88cbb178,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aeb0b3b17a264931868235fa17b5b30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:11Z,use_quota=True,user_id='d99b991b8254468bbab5c8fa598ff2c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4b3a96-1133-4a5e-b33e-847ca48a025c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4b3a96-1133-4a5e-b33e-847ca48a025c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83a75c1-0f9c-47c2-8a35-084755b64d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83a75c1-0f9c-47c2-8a35-084755b64d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afcd2ff4-09f5-4592-9517-e0af88cbb178', 'volume_name': 'volume-afcd2ff4-09f5-4592-9517-e0af88cbb178', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f17c673-72f0-48e7-ab22-26e2d39701ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f17c673-72f0-48e7-ab22-26e2d39701ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175ea235-8c58-485d-a9a0-bfd4add1285a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:11 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Volume afcd2ff4-09f5-4592-9517-e0af88cbb178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afcd2ff4-09f5-4592-9517-e0af88cbb178', 'volume_size': 1} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1942488511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcd2ff4-09f5-4592-9517-e0af88cbb178,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aeb0b3b17a264931868235fa17b5b30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:11Z,use_quota=True,user_id='d99b991b8254468bbab5c8fa598ff2c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Creating volume afcd2ff4-09f5-4592-9517-e0af88cbb178 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:47:11 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-afcd2ff4-09f5-4592-9517-e0af88cbb178 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:11 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-afcd2ff4-09f5-4592-9517-e0af88cbb178 1073741824 Nov 06 10:47:11 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:11 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707" returned: 0 in 0.420s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b687d4b7-7a6e-4738-9f60-093c270e81dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff5ff6a-b05a-4c75-acff-955fadc766ea]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:11 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 Nov 06 10:47:11 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:11 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-afcd2ff4-09f5-4592-9517-e0af88cbb178 1073741824" returned: 0 in 0.484s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-afcd2ff4-09f5-4592-9517-e0af88cbb178 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:11 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-afcd2ff4-09f5-4592-9517-e0af88cbb178 Nov 06 10:47:11 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:11 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535" returned: 0 in 0.409s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b687d4b7-7a6e-4738-9f60-093c270e81dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:11 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707 Nov 06 10:47:11 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:11 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-afcd2ff4-09f5-4592-9517-e0af88cbb178" returned: 0 in 0.323s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175ea235-8c58-485d-a9a0-bfd4add1285a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afcd2ff4-09f5-4592-9517-e0af88cbb178', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6722466a-afae-46d7-a055-2f01bceb2154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:12 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Volume volume-afcd2ff4-09f5-4592-9517-e0af88cbb178 (afcd2ff4-09f5-4592-9517-e0af88cbb178): created successfully Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6722466a-afae-46d7-a055-2f01bceb2154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Flow 'volume_create_manager' (32625021-80af-46df-a08a-53402b31ab98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Flow 'volume_create_manager' (d84f8fec-2a61-4d10-b51c-c56eb0109c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7f22d4-7577-4f90-8c7c-6fee148a5d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:12 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-30b163df-2ce3-499b-bcc8-b4c80ec135a9 tempest-VolumesListTestJSON-708856565 None] Created volume successfully. Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7f22d4-7577-4f90-8c7c-6fee148a5d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-607801937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f62efb2-756a-4085-8101-8757749cd71c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75616aa76eba4da3b69d16e41fa61c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:12Z,use_quota=True,user_id='70215f90be6247a1896ee7d01fe702b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1877fb8-b541-4196-82b1-dc05a111dd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1877fb8-b541-4196-82b1-dc05a111dd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea97377f-be5f-46be-9780-0fab50fc7e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.image.glance [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Creating Keystone auth plugin from conf {{(pid=86819) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 10:47:12 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707" returned: 0 in 0.456s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:12 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707 Nov 06 10:47:12 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea97377f-be5f-46be-9780-0fab50fc7e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8f62efb2-756a-4085-8101-8757749cd71c', 'volume_name': 'volume-8f62efb2-756a-4085-8101-8757749cd71c', 'volume_size': 1, 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a31bb778f245ada373212e6fd01b04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'created_at': datetime.datetime(2026, 11, 6, 9, 33, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3141da4f-e70d-439b-81af-e22387bd01d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cf832d-4c32-455a-a16b-396257a36958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:12 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cf832d-4c32-455a-a16b-396257a36958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9150f18-bf87-49e9-9f29-78a32e3dfff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:12 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Volume 8f62efb2-756a-4085-8101-8757749cd71c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8f62efb2-756a-4085-8101-8757749cd71c', 'volume_size': 1, 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a31bb778f245ada373212e6fd01b04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'created_at': datetime.datetime(2026, 11, 6, 9, 33, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3141da4f-e70d-439b-81af-e22387bd01d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Trying to clone 8f62efb2-756a-4085-8101-8757749cd71c from image 3141da4f-e70d-439b-81af-e22387bd01d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]). {{(pid=86819) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.f0048fc2-cc88-491f-b76c-6f4a1eb10707" returned: 0 in 0.282s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-f0048fc2-cc88-491f-b76c-6f4a1eb10707" released by "_delete_snapshot" :: held 1.704s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" released by "delete_snapshot" :: held 1.735s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Created reservations ['3a06206c-8136-4fd2-8950-cbd3d132cbc1', 'e16988a1-beab-4e09-b27b-915f8b605a01', '085b67ef-45b8-4dc9-8cc7-1d98577647f8', 'f67db3b3-9647-4b61-ac51-7ea9aac22b2a'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:12 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Delete snapshot completed successfully. Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fac4f17d-5c9d-4bd9-852a-ebf0b91474a3 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-f0048fc2-cc88-491f-b76c-6f4a1eb10707-delete_snapshot" released by "delete_snapshot" :: held 2.031s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_4nt0dc4mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 10:47:12 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Image download 20.69 MB at 20.69 MB/s Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e74cbd-19bd-48de-a19a-dc5ae52af4a8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_4nt0dc4mdevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:13 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_4nt0dc4mdevstack@QuobyteHD Nov 06 10:47:13 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:13 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_4nt0dc4mdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Temporary image 3141da4f-e70d-439b-81af-e22387bd01d4 is fetched for user 70215f90be6247a1896ee7d01fe702b3. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a1f8c7ef-bc0a-49e6-880d-1fa53bd7e4d4 tempest-SnapshotsActionsTest-2134058876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a1f8c7ef-bc0a-49e6-880d-1fa53bd7e4d4 tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a1f8c7ef-bc0a-49e6-880d-1fa53bd7e4d4 tempest-SnapshotsActionsTest-2134058876 None] Creating offline snapshot e960df03-56e7-4171-9d33-131b507a8823 of volume b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b95759-464d-4fca-aabb-f356eeecd393]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a1f8c7ef-bc0a-49e6-880d-1fa53bd7e4d4 tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddb2e28-14a5-4033-910f-7f6e5cc38a63]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_4nt0dc4mdevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:13 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 Nov 06 10:47:13 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:13 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_4nt0dc4mdevstack@QuobyteHD Nov 06 10:47:13 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Flow 'volume_create_manager' (1c1061b1-fda9-4c61-8717-2da6f6662e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e749500e-b30c-4427-afa2-4eb25a820dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e749500e-b30c-4427-afa2-4eb25a820dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-825820290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d466856-5d49-464e-835f-45ab3e1e4530,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aeb0b3b17a264931868235fa17b5b30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:14Z,use_quota=True,user_id='d99b991b8254468bbab5c8fa598ff2c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc638545-e599-4c58-a20a-ed99368e0f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc638545-e599-4c58-a20a-ed99368e0f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276c1360-7180-40dc-80e9-7f3ce2662876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276c1360-7180-40dc-80e9-7f3ce2662876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d466856-5d49-464e-835f-45ab3e1e4530', 'volume_name': 'volume-9d466856-5d49-464e-835f-45ab3e1e4530', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c8ac99-0681-4516-86e9-2c20cbab6059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c8ac99-0681-4516-86e9-2c20cbab6059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440bcdbf-efe5-4b0c-937c-2d9dc3aee79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:13 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Volume 9d466856-5d49-464e-835f-45ab3e1e4530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d466856-5d49-464e-835f-45ab3e1e4530', 'volume_size': 1} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:13 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:13 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_4nt0dc4mdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a1f8c7ef-bc0a-49e6-880d-1fa53bd7e4d4 tempest-SnapshotsActionsTest-2134058876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535" returned: 0 in 0.425s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a1f8c7ef-bc0a-49e6-880d-1fa53bd7e4d4 tempest-SnapshotsActionsTest-2134058876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b687d4b7-7a6e-4738-9f60-093c270e81dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a1f8c7ef-bc0a-49e6-880d-1fa53bd7e4d4 tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:13 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823 1G Nov 06 10:47:13 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:14 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a1f8c7ef-bc0a-49e6-880d-1fa53bd7e4d4 tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823 1G" returned: 0 in 0.427s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a1f8c7ef-bc0a-49e6-880d-1fa53bd7e4d4 tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:14 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823 Nov 06 10:47:14 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:14 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a1f8c7ef-bc0a-49e6-880d-1fa53bd7e4d4 tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823" returned: 0 in 0.287s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:14 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-a1f8c7ef-bc0a-49e6-880d-1fa53bd7e4d4 tempest-SnapshotsActionsTest-2134058876 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823 is being set with open permissions: ugo+rw Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a1f8c7ef-bc0a-49e6-880d-1fa53bd7e4d4 tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:14 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823 Nov 06 10:47:14 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:14 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a1f8c7ef-bc0a-49e6-880d-1fa53bd7e4d4 tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823" returned: 0 in 0.249s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a1f8c7ef-bc0a-49e6-880d-1fa53bd7e4d4 tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.513s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-825820290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d466856-5d49-464e-835f-45ab3e1e4530,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aeb0b3b17a264931868235fa17b5b30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:14Z,use_quota=True,user_id='d99b991b8254468bbab5c8fa598ff2c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Creating volume 9d466856-5d49-464e-835f-45ab3e1e4530 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:47:14 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:47:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d466856-5d49-464e-835f-45ab3e1e4530 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:14 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d466856-5d49-464e-835f-45ab3e1e4530 1073741824 Nov 06 10:47:14 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:14 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a1f8c7ef-bc0a-49e6-880d-1fa53bd7e4d4 tempest-SnapshotsActionsTest-2134058876 None] Create snapshot completed successfully Nov 06 10:47:15 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d466856-5d49-464e-835f-45ab3e1e4530 1073741824" returned: 0 in 0.478s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d466856-5d49-464e-835f-45ab3e1e4530 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:15 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d466856-5d49-464e-835f-45ab3e1e4530 Nov 06 10:47:15 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Acquiring lock "cinder-e960df03-56e7-4171-9d33-131b507a8823-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-e960df03-56e7-4171-9d33-131b507a8823-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Acquiring lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Acquiring lock "cinder-quobyte-e960df03-56e7-4171-9d33-131b507a8823" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-e960df03-56e7-4171-9d33-131b507a8823" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Deleting offline snapshot e960df03-56e7-4171-9d33-131b507a8823 of volume b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:47:15 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] snapshot_file for this snap is: volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d466856-5d49-464e-835f-45ab3e1e4530" returned: 0 in 0.274s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.821s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-607801937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f62efb2-756a-4085-8101-8757749cd71c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75616aa76eba4da3b69d16e41fa61c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:12Z,use_quota=True,user_id='70215f90be6247a1896ee7d01fe702b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Creating volume 8f62efb2-756a-4085-8101-8757749cd71c {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:47:15 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cc4968-9e18-479c-9259-86aeb63cd793]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:15 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c 1073741824 Nov 06 10:47:15 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440bcdbf-efe5-4b0c-937c-2d9dc3aee79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d466856-5d49-464e-835f-45ab3e1e4530', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089378d6-23ad-49f5-bf67-a71d46da12fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:15 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Volume volume-9d466856-5d49-464e-835f-45ab3e1e4530 (9d466856-5d49-464e-835f-45ab3e1e4530): created successfully Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089378d6-23ad-49f5-bf67-a71d46da12fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Flow 'volume_create_manager' (1c1061b1-fda9-4c61-8717-2da6f6662e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:15 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-512c432d-57e4-4184-9965-67051bb63c5d tempest-VolumesListTestJSON-708856565 None] Created volume successfully. Nov 06 10:47:15 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823 Nov 06 10:47:15 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:16 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823" returned: 0 in 0.403s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b687d4b7-7a6e-4738-9f60-093c270e81dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f733f5-4e54-43bb-b33b-48ab2f3d25b5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:16 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c 1073741824" returned: 0 in 0.466s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:16 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c Nov 06 10:47:16 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:16 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 Nov 06 10:47:16 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:16 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c" returned: 0 in 0.274s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Attempting download of 3141da4f-e70d-439b-81af-e22387bd01d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}])) to volume 8f62efb2-756a-4085-8101-8757749cd71c. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 10:47:16 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535" returned: 0 in 0.407s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b687d4b7-7a6e-4738-9f60-093c270e81dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17554fa-7501-40e2-8a7e-54cda5a63b44]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_eplrc6jp {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:16 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823 Nov 06 10:47:16 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:16 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_eplrc6jp Nov 06 10:47:16 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:16 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_eplrc6jp" returned: 0 in 0.351s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_eplrc6jp {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:16 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823" returned: 0 in 0.435s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:16 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823 Nov 06 10:47:16 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:16 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_eplrc6jp Nov 06 10:47:16 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:17 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_eplrc6jp" returned: 1 in 0.361s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_eplrc6jp' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd73d46-e50b-464b-905d-ff3037ea3c80]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_4nt0dc4mdevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:17 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.e960df03-56e7-4171-9d33-131b507a8823" returned: 0 in 0.322s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-e960df03-56e7-4171-9d33-131b507a8823" released by "_delete_snapshot" :: held 1.725s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" released by "delete_snapshot" :: held 1.751s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:17 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_4nt0dc4mdevstack@QuobyteHD Nov 06 10:47:17 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Created reservations ['82003241-a540-4799-a8e7-2e1aceb6153d', '56bae8a6-08a6-4c8a-955e-e90aafb5a6c7', '591af0e4-d43f-4b28-981e-437378d567a8', 'd2d6041f-fe4e-408f-a937-6888cf6edd1b'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Flow 'volume_create_manager' (7db20eb3-d637-4ae1-b73e-d99346134b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa148c22-cdbf-4d2f-8415-4f592f331b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa148c22-cdbf-4d2f-8415-4f592f331b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1910083370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1478d3-7482-4164-868b-0a38e76800cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aeb0b3b17a264931868235fa17b5b30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:17Z,use_quota=True,user_id='d99b991b8254468bbab5c8fa598ff2c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea193430-d71c-4769-9613-9838e6e8a499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea193430-d71c-4769-9613-9838e6e8a499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee877c30-d401-411d-8c07-d6036aba6b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee877c30-d401-411d-8c07-d6036aba6b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1478d3-7482-4164-868b-0a38e76800cd', 'volume_name': 'volume-df1478d3-7482-4164-868b-0a38e76800cd', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de67d18c-ddec-4c44-aa38-1b25a76948a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de67d18c-ddec-4c44-aa38-1b25a76948a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc2cacd-3fd3-4daf-9d36-0be81b9dac86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:17 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Volume df1478d3-7482-4164-868b-0a38e76800cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1478d3-7482-4164-868b-0a38e76800cd', 'volume_size': 1} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1910083370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1478d3-7482-4164-868b-0a38e76800cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aeb0b3b17a264931868235fa17b5b30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:17Z,use_quota=True,user_id='d99b991b8254468bbab5c8fa598ff2c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Creating volume df1478d3-7482-4164-868b-0a38e76800cd {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:47:17 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-df1478d3-7482-4164-868b-0a38e76800cd 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:17 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-df1478d3-7482-4164-868b-0a38e76800cd 1073741824 Nov 06 10:47:17 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:17 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Delete snapshot completed successfully. Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a0669af1-de21-4725-9613-547ecee9de98 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-e960df03-56e7-4171-9d33-131b507a8823-delete_snapshot" released by "delete_snapshot" :: held 2.027s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:17 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_4nt0dc4mdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] 3141da4f-e70d-439b-81af-e22387bd01d4 was qcow2, converting to qcow2 {{(pid=86819) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_4nt0dc4mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:17 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_4nt0dc4mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c Nov 06 10:47:17 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9e6c72ab-d9c4-49f6-9691-7f2aab2b2903 tempest-SnapshotsActionsTest-2134058876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:17 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-df1478d3-7482-4164-868b-0a38e76800cd 1073741824" returned: 0 in 0.485s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-df1478d3-7482-4164-868b-0a38e76800cd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:18 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-df1478d3-7482-4164-868b-0a38e76800cd Nov 06 10:47:18 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:18 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-df1478d3-7482-4164-868b-0a38e76800cd" returned: 0 in 0.254s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:47:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9e6c72ab-d9c4-49f6-9691-7f2aab2b2903 tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.312s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc2cacd-3fd3-4daf-9d36-0be81b9dac86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1478d3-7482-4164-868b-0a38e76800cd', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a8d8f5-5293-4dc0-8f36-e68ba62bed07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9e6c72ab-d9c4-49f6-9691-7f2aab2b2903 tempest-SnapshotsActionsTest-2134058876 None] Creating offline snapshot 09b149c7-e8e1-4b61-836a-39a00aa70731 of volume b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:47:18 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Volume volume-df1478d3-7482-4164-868b-0a38e76800cd (df1478d3-7482-4164-868b-0a38e76800cd): created successfully Nov 06 10:47:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a8d8f5-5293-4dc0-8f36-e68ba62bed07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Flow 'volume_create_manager' (7db20eb3-d637-4ae1-b73e-d99346134b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:18 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4cea40-ce7c-4b6c-b28f-39375274064d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9e6c72ab-d9c4-49f6-9691-7f2aab2b2903 tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:18 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b0be8876-7d95-4c3f-9f24-0f574a737bd1 tempest-VolumesListTestJSON-708856565 None] Created volume successfully. Nov 06 10:47:18 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 Nov 06 10:47:18 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:18 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9e6c72ab-d9c4-49f6-9691-7f2aab2b2903 tempest-SnapshotsActionsTest-2134058876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535" returned: 0 in 0.415s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9e6c72ab-d9c4-49f6-9691-7f2aab2b2903 tempest-SnapshotsActionsTest-2134058876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b687d4b7-7a6e-4738-9f60-093c270e81dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9e6c72ab-d9c4-49f6-9691-7f2aab2b2903 tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:18 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731 1G Nov 06 10:47:18 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:19 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9e6c72ab-d9c4-49f6-9691-7f2aab2b2903 tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731 1G" returned: 0 in 0.486s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9e6c72ab-d9c4-49f6-9691-7f2aab2b2903 tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:19 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731 Nov 06 10:47:19 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:19 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_4nt0dc4mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c" returned: 0 in 1.934s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:19 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_4nt0dc4mdevstack@QuobyteHD, size 112.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:47:19 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Converted 112.00 MB image at 57.88 MB/s Nov 06 10:47:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:19 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c 1G Nov 06 10:47:19 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:19 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9e6c72ab-d9c4-49f6-9691-7f2aab2b2903 tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731" returned: 0 in 0.364s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:19 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-9e6c72ab-d9c4-49f6-9691-7f2aab2b2903 tempest-SnapshotsActionsTest-2134058876 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731 is being set with open permissions: ugo+rw Nov 06 10:47:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9e6c72ab-d9c4-49f6-9691-7f2aab2b2903 tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:19 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731 Nov 06 10:47:19 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:19 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c 1G" returned: 0 in 0.348s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:19 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Downloaded image 3141da4f-e70d-439b-81af-e22387bd01d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}])) to volume 8f62efb2-756a-4085-8101-8757749cd71c successfully. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 10:47:19 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Temporary image 3141da4f-e70d-439b-81af-e22387bd01d4 for user 70215f90be6247a1896ee7d01fe702b3 is deleted. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 10:47:19 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Marking volume 8f62efb2-756a-4085-8101-8757749cd71c as bootable. {{(pid=86819) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 10:47:19 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Copying metadata from image 3141da4f-e70d-439b-81af-e22387bd01d4 to 8f62efb2-756a-4085-8101-8757749cd71c. {{(pid=86819) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 10:47:19 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Creating volume glance metadata for volume 8f62efb2-756a-4085-8101-8757749cd71c backed by image 3141da4f-e70d-439b-81af-e22387bd01d4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86819) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 10:47:19 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9e6c72ab-d9c4-49f6-9691-7f2aab2b2903 tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731" returned: 0 in 0.276s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9e6c72ab-d9c4-49f6-9691-7f2aab2b2903 tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.694s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:20 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9e6c72ab-d9c4-49f6-9691-7f2aab2b2903 tempest-SnapshotsActionsTest-2134058876 None] Create snapshot completed successfully Nov 06 10:47:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9150f18-bf87-49e9-9f29-78a32e3dfff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f62efb2-756a-4085-8101-8757749cd71c', 'volume_size': 1, 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a31bb778f245ada373212e6fd01b04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'created_at': datetime.datetime(2026, 11, 6, 9, 33, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3141da4f-e70d-439b-81af-e22387bd01d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf84668-ec41-4ac7-96d1-a43f699f07b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:20 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Volume volume-8f62efb2-756a-4085-8101-8757749cd71c (8f62efb2-756a-4085-8101-8757749cd71c): created successfully Nov 06 10:47:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf84668-ec41-4ac7-96d1-a43f699f07b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Flow 'volume_create_manager' (d84f8fec-2a61-4d10-b51c-c56eb0109c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:20 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9f053ae7-fa11-4b9e-9f26-c93a895b366b tempest-VolumesExtendTest-1234594248 None] Created volume successfully. Nov 06 10:47:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e68b377e-66b9-4d42-8430-8e69f7ed54e5 tempest-VolumesExtendTest-1234594248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e68b377e-66b9-4d42-8430-8e69f7ed54e5 tempest-VolumesExtendTest-1234594248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:20 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6068a32-5284-4aeb-95ca-ea05bcea6b43]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e68b377e-66b9-4d42-8430-8e69f7ed54e5 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:20 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c Nov 06 10:47:20 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Flow 'volume_create_manager' (81eb4bad-4b6b-4a1f-a43c-12b98221a28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c40b89-90ed-4bba-a2fb-453b406922b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:21 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c40b89-90ed-4bba-a2fb-453b406922b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1152638712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979eca52-77a4-4b4f-bc97-4b6e9991ebbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a0c02fdac44d793b586450ce5a515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:21Z,use_quota=True,user_id='4dd5b0cbf7d34e44aeaaccde209a98b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d411d8b-86e7-451c-98dc-f3fe17ff4fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d411d8b-86e7-451c-98dc-f3fe17ff4fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bdf0d2-9c6c-4d8e-8c6d-51a8df31b60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bdf0d2-9c6c-4d8e-8c6d-51a8df31b60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '979eca52-77a4-4b4f-bc97-4b6e9991ebbd', 'volume_name': 'volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7c9ffe-e840-415a-95be-1e4cdaf0cdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7c9ffe-e840-415a-95be-1e4cdaf0cdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd8c897-0ce8-4d5c-9398-8f84ae0817c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:21 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Volume 979eca52-77a4-4b4f-bc97-4b6e9991ebbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd', 'volume_size': 1} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e68b377e-66b9-4d42-8430-8e69f7ed54e5 tempest-VolumesExtendTest-1234594248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c" returned: 0 in 0.467s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e68b377e-66b9-4d42-8430-8e69f7ed54e5 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c 2G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Acquiring lock "cinder-09b149c7-e8e1-4b61-836a-39a00aa70731-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-09b149c7-e8e1-4b61-836a-39a00aa70731-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Acquiring lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e68b377e-66b9-4d42-8430-8e69f7ed54e5 tempest-VolumesExtendTest-1234594248 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c 2G" returned: 0 in 0.128s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e68b377e-66b9-4d42-8430-8e69f7ed54e5 tempest-VolumesExtendTest-1234594248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.625s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Acquiring lock "cinder-quobyte-09b149c7-e8e1-4b61-836a-39a00aa70731" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.150s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1152638712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979eca52-77a4-4b4f-bc97-4b6e9991ebbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783a0c02fdac44d793b586450ce5a515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:21Z,use_quota=True,user_id='4dd5b0cbf7d34e44aeaaccde209a98b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Creating volume 979eca52-77a4-4b4f-bc97-4b6e9991ebbd {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:47:21 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:21 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd 1073741824 Nov 06 10:47:21 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-09b149c7-e8e1-4b61-836a-39a00aa70731" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Deleting offline snapshot 09b149c7-e8e1-4b61-836a-39a00aa70731 of volume b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] snapshot_file for this snap is: volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aec86c-698c-4d93-a0fc-d66362a70097]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:21 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-e68b377e-66b9-4d42-8430-8e69f7ed54e5 tempest-VolumesExtendTest-1234594248 None] Extend volume completed successfully. Nov 06 10:47:21 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731 Nov 06 10:47:21 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:21 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731" returned: 0 in 0.412s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b687d4b7-7a6e-4738-9f60-093c270e81dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:21 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd 1073741824" returned: 0 in 0.531s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f932c8e-6023-416b-8fa4-00e70dce0cde]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Acquiring lock "cinder-df1478d3-7482-4164-868b-0a38e76800cd-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:21 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd Nov 06 10:47:21 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Lock "cinder-df1478d3-7482-4164-868b-0a38e76800cd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:21 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 Nov 06 10:47:21 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Acquiring lock "cinder-quobyte-df1478d3-7482-4164-868b-0a38e76800cd" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Lock "cinder-quobyte-df1478d3-7482-4164-868b-0a38e76800cd" acquired by "delete_volume" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e51e430-cbbc-4239-8b91-9650ee30adde]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-df1478d3-7482-4164-868b-0a38e76800cd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:22 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd" returned: 0 in 0.312s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd8c897-0ce8-4d5c-9398-8f84ae0817c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:22 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-df1478d3-7482-4164-868b-0a38e76800cd Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a49e9f-1059-4ee8-8f79-9220c8301c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:22 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:22 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Volume volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd (979eca52-77a4-4b4f-bc97-4b6e9991ebbd): created successfully Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a49e9f-1059-4ee8-8f79-9220c8301c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Flow 'volume_create_manager' (81eb4bad-4b6b-4a1f-a43c-12b98221a28a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:22 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-bd91c3b0-1137-4b41-b9fd-d800a32dd5fd tempest-AttachVolumeNegativeTest-1480812843 None] Created volume successfully. Nov 06 10:47:22 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535" returned: 0 in 0.435s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b687d4b7-7a6e-4738-9f60-093c270e81dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Acquiring lock "cinder-8f62efb2-756a-4085-8101-8757749cd71c-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:22 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731 Nov 06 10:47:22 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Lock "cinder-8f62efb2-756a-4085-8101-8757749cd71c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Acquiring lock "cinder-quobyte-8f62efb2-756a-4085-8101-8757749cd71c" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Lock "cinder-quobyte-8f62efb2-756a-4085-8101-8757749cd71c" acquired by "delete_volume" :: waited 0.035s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d0282f-11e6-4bc1-b7b0-ad52ea6f2311]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:22 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-df1478d3-7482-4164-868b-0a38e76800cd" returned: 0 in 0.454s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-df1478d3-7482-4164-868b-0a38e76800cd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:22 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-df1478d3-7482-4164-868b-0a38e76800cd Nov 06 10:47:22 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:22 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c Nov 06 10:47:22 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:22 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731" returned: 0 in 0.406s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:22 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731 Nov 06 10:47:22 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:22 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-df1478d3-7482-4164-868b-0a38e76800cd" returned: 0 in 0.269s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Lock "cinder-quobyte-df1478d3-7482-4164-868b-0a38e76800cd" released by "delete_volume" :: held 0.794s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:22 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c" returned: 0 in 0.388s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Created reservations ['bf29e068-3e0e-47e8-81cb-f77588e1a4ba', 'dca19595-8252-44b6-ae02-540ce7b634d5', '150262b2-6f83-48b1-86e8-5374aacf4ca0', 'dd823698-7dbd-4c45-8e8f-4d59fe22a5ec'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:22 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c Nov 06 10:47:22 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:22 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:47:22 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:22 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.09b149c7-e8e1-4b61-836a-39a00aa70731" returned: 0 in 0.278s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-09b149c7-e8e1-4b61-836a-39a00aa70731" released by "_delete_snapshot" :: held 1.669s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" released by "delete_snapshot" :: held 1.733s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:23 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8f62efb2-756a-4085-8101-8757749cd71c" returned: 0 in 0.274s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Lock "cinder-quobyte-8f62efb2-756a-4085-8101-8757749cd71c" released by "delete_volume" :: held 0.721s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Created reservations ['ace0e5d2-8006-4d48-97ef-8ae48e7c785c', 'b5783581-e7f6-4ab4-abc1-644de433b2cd', '742b711c-8d35-40eb-a19a-3e361ac303f6', '0499dd18-80bc-445e-b94c-f27c0f8f4575'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Acquiring lock "cinder-9d466856-5d49-464e-835f-45ab3e1e4530-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:23 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.305s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Lock "cinder-9d466856-5d49-464e-835f-45ab3e1e4530-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Created reservations ['06907c43-4070-4cbe-b622-b0c681e0b6e4', '6f459055-2888-407d-bbb6-6a737289e141', 'c9a2f14a-f244-428b-a86f-eb60b663d00d', '254119b8-6aa0-403d-98ff-f5c23f650220'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Deleted volume successfully. Nov 06 10:47:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Delete snapshot completed successfully. Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-95f0fabe-44bd-4b28-9fec-562e6387c2c0 tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-09b149c7-e8e1-4b61-836a-39a00aa70731-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a972b356-d391-410d-830c-fa7210e148f2 tempest-VolumesListTestJSON-708856565 None] Lock "cinder-df1478d3-7482-4164-868b-0a38e76800cd-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Acquiring lock "cinder-quobyte-9d466856-5d49-464e-835f-45ab3e1e4530" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Lock "cinder-quobyte-9d466856-5d49-464e-835f-45ab3e1e4530" acquired by "delete_volume" :: waited 0.058s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:23 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:47:23 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[880fdd3b-4207-400b-a47b-25c8b0c645ce]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d466856-5d49-464e-835f-45ab3e1e4530 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:23 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d466856-5d49-464e-835f-45ab3e1e4530 Nov 06 10:47:23 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:23 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.321s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:47:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Deleted volume successfully. Nov 06 10:47:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9c0522ee-b377-495f-b4f6-be9e37b83838 tempest-VolumesExtendTest-1234594248 None] Lock "cinder-8f62efb2-756a-4085-8101-8757749cd71c-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:24 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d466856-5d49-464e-835f-45ab3e1e4530" returned: 0 in 0.488s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d466856-5d49-464e-835f-45ab3e1e4530 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:24 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d466856-5d49-464e-835f-45ab3e1e4530 Nov 06 10:47:24 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c0b81232-bc2e-48a5-b7ab-f18719fb6c5b tempest-SnapshotsActionsTest-2134058876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c0b81232-bc2e-48a5-b7ab-f18719fb6c5b tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Flow 'volume_create_manager' (47328dda-ad5e-427b-b926-7c8f6e4b5093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e2b111-2a48-4b57-8af1-1ced783e5cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c0b81232-bc2e-48a5-b7ab-f18719fb6c5b tempest-SnapshotsActionsTest-2134058876 None] Creating offline snapshot 535264b0-1ef7-4780-8111-1bea358ecf82 of volume b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e2b111-2a48-4b57-8af1-1ced783e5cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-754482605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a7628e-144b-4d4e-aee4-e485dc28c912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75616aa76eba4da3b69d16e41fa61c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:24Z,use_quota=True,user_id='70215f90be6247a1896ee7d01fe702b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38746cba-766e-44f8-ba17-e52d963875f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38746cba-766e-44f8-ba17-e52d963875f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:24 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb32990d-8963-46a6-9377-1093a797b129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb32990d-8963-46a6-9377-1093a797b129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a7628e-144b-4d4e-aee4-e485dc28c912', 'volume_name': 'volume-89a7628e-144b-4d4e-aee4-e485dc28c912', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39be4606-9ba9-4e03-ad5e-036e6cab1963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39be4606-9ba9-4e03-ad5e-036e6cab1963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea47dee-6fe4-4c42-801c-ac5bc99eb04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:24 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Volume 89a7628e-144b-4d4e-aee4-e485dc28c912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a7628e-144b-4d4e-aee4-e485dc28c912', 'volume_size': 1} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eff2945-8041-4027-913a-af9ac2a6263f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c0b81232-bc2e-48a5-b7ab-f18719fb6c5b tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d466856-5d49-464e-835f-45ab3e1e4530" returned: 0 in 0.316s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Lock "cinder-quobyte-9d466856-5d49-464e-835f-45ab3e1e4530" released by "delete_volume" :: held 0.876s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-fc758034-2d8a-48b4-a091-e16bb0e2f25f req-b0363093-51bd-41f2-8f5c-f05c3526b317 tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Created reservations ['e5591e96-87c0-408e-ad3f-6946d0ffae28', '3c7d938b-7bbb-43f7-b761-04a3122a8f7f', '6d2c375b-eae3-4411-b3df-ea4dfc1a4b49', 'df287f93-2875-46b7-a943-d667609ec9fb'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:24 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 Nov 06 10:47:24 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:24 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:47:24 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:24 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c0b81232-bc2e-48a5-b7ab-f18719fb6c5b tempest-SnapshotsActionsTest-2134058876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535" returned: 0 in 0.356s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c0b81232-bc2e-48a5-b7ab-f18719fb6c5b tempest-SnapshotsActionsTest-2134058876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b687d4b7-7a6e-4738-9f60-093c270e81dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c0b81232-bc2e-48a5-b7ab-f18719fb6c5b tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:24 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82 1G Nov 06 10:47:24 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:24 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.253s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:47:24 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Deleted volume successfully. Nov 06 10:47:24 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3db1d961-30cc-4cc3-932a-9373b63c5dad tempest-VolumesListTestJSON-708856565 None] Lock "cinder-9d466856-5d49-464e-835f-45ab3e1e4530-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:25 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c0b81232-bc2e-48a5-b7ab-f18719fb6c5b tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82 1G" returned: 0 in 0.460s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c0b81232-bc2e-48a5-b7ab-f18719fb6c5b tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:25 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82 Nov 06 10:47:25 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:25 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c0b81232-bc2e-48a5-b7ab-f18719fb6c5b tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82" returned: 0 in 0.292s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:25 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-c0b81232-bc2e-48a5-b7ab-f18719fb6c5b tempest-SnapshotsActionsTest-2134058876 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82 is being set with open permissions: ugo+rw Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c0b81232-bc2e-48a5-b7ab-f18719fb6c5b tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:25 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82 Nov 06 10:47:25 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Acquiring lock "cinder-afcd2ff4-09f5-4592-9517-e0af88cbb178-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Lock "cinder-afcd2ff4-09f5-4592-9517-e0af88cbb178-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Acquiring lock "cinder-quobyte-afcd2ff4-09f5-4592-9517-e0af88cbb178" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Lock "cinder-quobyte-afcd2ff4-09f5-4592-9517-e0af88cbb178" acquired by "delete_volume" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0c3aea-9f87-4071-9932-8ea1d7942a10]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-afcd2ff4-09f5-4592-9517-e0af88cbb178 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:25 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c0b81232-bc2e-48a5-b7ab-f18719fb6c5b tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82" returned: 0 in 0.256s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:25 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-afcd2ff4-09f5-4592-9517-e0af88cbb178 Nov 06 10:47:25 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c0b81232-bc2e-48a5-b7ab-f18719fb6c5b tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.565s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.413s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-754482605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a7628e-144b-4d4e-aee4-e485dc28c912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75616aa76eba4da3b69d16e41fa61c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:24Z,use_quota=True,user_id='70215f90be6247a1896ee7d01fe702b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Creating volume 89a7628e-144b-4d4e-aee4-e485dc28c912 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:47:25 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:25 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912 1073741824 Nov 06 10:47:25 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:25 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c0b81232-bc2e-48a5-b7ab-f18719fb6c5b tempest-SnapshotsActionsTest-2134058876 None] Create snapshot completed successfully Nov 06 10:47:25 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-afcd2ff4-09f5-4592-9517-e0af88cbb178" returned: 0 in 0.368s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-afcd2ff4-09f5-4592-9517-e0af88cbb178 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:26 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-afcd2ff4-09f5-4592-9517-e0af88cbb178 Nov 06 10:47:26 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:26 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912 1073741824" returned: 0 in 0.492s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:26 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-afcd2ff4-09f5-4592-9517-e0af88cbb178" returned: 0 in 0.282s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Lock "cinder-quobyte-afcd2ff4-09f5-4592-9517-e0af88cbb178" released by "delete_volume" :: held 0.704s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:26 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912 Nov 06 10:47:26 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Acquiring lock "cinder-535264b0-1ef7-4780-8111-1bea358ecf82-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Created reservations ['166897fe-ea69-4c03-a184-dcf48d80e3b1', '83ad2b75-b5bd-46ab-9cd3-38eeb5edb1bb', '1fbbbdaa-c5cb-4c92-8bb9-f579460cb19e', 'a4f9b943-2d61-4eb3-b048-96a1ff372d54'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-535264b0-1ef7-4780-8111-1bea358ecf82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Acquiring lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Acquiring lock "cinder-quobyte-535264b0-1ef7-4780-8111-1bea358ecf82" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-535264b0-1ef7-4780-8111-1bea358ecf82" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Deleting offline snapshot 535264b0-1ef7-4780-8111-1bea358ecf82 of volume b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] snapshot_file for this snap is: volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2456f267-819f-498f-90f5-e8ef3cea05bb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:26 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:47:26 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:26 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:26 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82 Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912" returned: 0 in 0.283s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:26 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-fc758034-2d8a-48b4-a091-e16bb0e2f25f req-b0363093-51bd-41f2-8f5c-f05c3526b317 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.228s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-fc758034-2d8a-48b4-a091-e16bb0e2f25f req-b0363093-51bd-41f2-8f5c-f05c3526b317 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea47dee-6fe4-4c42-801c-ac5bc99eb04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a7628e-144b-4d4e-aee4-e485dc28c912', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85e0d26-729d-4a61-bf85-1ae29a832b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:26 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Volume volume-89a7628e-144b-4d4e-aee4-e485dc28c912 (89a7628e-144b-4d4e-aee4-e485dc28c912): created successfully Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85e0d26-729d-4a61-bf85-1ae29a832b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Flow 'volume_create_manager' (47328dda-ad5e-427b-b926-7c8f6e4b5093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:26 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-22c1693d-2951-4fed-966b-a8bacf8b3d62 tempest-VolumesExtendTest-1234594248 None] Created volume successfully. Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-fc758034-2d8a-48b4-a091-e16bb0e2f25f req-b0363093-51bd-41f2-8f5c-f05c3526b317 tempest-AttachVolumeNegativeTest-1480812843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48319148-0188-437c-8902-c607081b1715', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:47:26 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-fc758034-2d8a-48b4-a091-e16bb0e2f25f req-b0363093-51bd-41f2-8f5c-f05c3526b317 tempest-AttachVolumeNegativeTest-1480812843 None] attachment_update completed successfully. Nov 06 10:47:26 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.283s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:47:26 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Deleted volume successfully. Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-df812b3d-7973-4362-83a0-7f27aa8c963b tempest-VolumesListTestJSON-708856565 None] Lock "cinder-afcd2ff4-09f5-4592-9517-e0af88cbb178-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:26 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82" returned: 0 in 0.474s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b687d4b7-7a6e-4738-9f60-093c270e81dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:27 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ce6e5b-004f-4a27-a979-2e12155254d5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:27 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 Nov 06 10:47:27 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:27 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535" returned: 0 in 0.579s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b687d4b7-7a6e-4738-9f60-093c270e81dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:27 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82 Nov 06 10:47:27 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] Creating offline snapshot 64ceff6f-f62f-445b-a29d-dfd8a24fbd4a of volume 89a7628e-144b-4d4e-aee4-e485dc28c912 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:47:27 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c679325-486e-4824-9cf9-9d2ccdedd507]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:27 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912 Nov 06 10:47:27 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:28 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82" returned: 0 in 0.530s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:28 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912" returned: 0 in 0.412s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:28 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82 Nov 06 10:47:28 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:28 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a 1G Nov 06 10:47:28 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:28 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.535264b0-1ef7-4780-8111-1bea358ecf82" returned: 0 in 0.293s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-535264b0-1ef7-4780-8111-1bea358ecf82" released by "_delete_snapshot" :: held 2.050s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" released by "delete_snapshot" :: held 2.088s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:28 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Created reservations ['5b7ccbbe-0bfe-4ab7-8355-b497d505f24a', 'eb15be44-f0a7-415f-916d-87825206fc78', 'cf0cb7ea-5bca-47f3-bde3-a56a203e387b', '58f7a2cf-e04d-4700-a830-60d7daac2b45'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:28 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Delete snapshot completed successfully. Nov 06 10:47:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-564cfa34-3bd1-492e-b008-28896e434f7c tempest-SnapshotsActionsTest-1294009625 None] Lock "cinder-535264b0-1ef7-4780-8111-1bea358ecf82-delete_snapshot" released by "delete_snapshot" :: held 2.306s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:28 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a 1G" returned: 0 in 0.572s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a7628e-144b-4d4e-aee4-e485dc28c912 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:28 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a7628e-144b-4d4e-aee4-e485dc28c912 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a Nov 06 10:47:28 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:29 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a7628e-144b-4d4e-aee4-e485dc28c912 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a" returned: 0 in 0.340s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:29 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a is being set with open permissions: ugo+rw Nov 06 10:47:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:29 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a Nov 06 10:47:29 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:29 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-0cfa89f4-28a9-4535-8e64-1661c165030c req-85280ecf-a99f-409f-8081-dd9da8d2a9e1 tempest-AttachVolumeNegativeTest-1480812843 None] Terminate volume connection completed successfully. Nov 06 10:47:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0cfa89f4-28a9-4535-8e64-1661c165030c req-85280ecf-a99f-409f-8081-dd9da8d2a9e1 tempest-AttachVolumeNegativeTest-1480812843 None] Deleting attachment 48319148-0188-437c-8902-c607081b1715. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:47:29 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a" returned: 0 in 0.335s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:29 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.info Nov 06 10:47:29 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:29 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.info" returned: 0 in 0.296s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:29 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.info is being set with open permissions: ugo+rw Nov 06 10:47:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:29 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.info Nov 06 10:47:29 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:30 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.info" returned: 0 in 0.296s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-79a15e46-80b1-4b2f-ab5a-2ab25a2db399 tempest-VolumesExtendTest-1234594248 None] Create snapshot completed successfully Nov 06 10:47:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Acquiring lock "cinder-ee5bc5dc-33e6-4c37-8b11-ac8644804535-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Lock "cinder-ee5bc5dc-33e6-4c37-8b11-ac8644804535-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Acquiring lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Acquiring lock "cinder-quobyte-ee5bc5dc-33e6-4c37-8b11-ac8644804535" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Lock "cinder-quobyte-ee5bc5dc-33e6-4c37-8b11-ac8644804535" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Deleting offline snapshot ee5bc5dc-33e6-4c37-8b11-ac8644804535 of volume b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:47:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] snapshot_file for this snap is: volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:47:30 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[765077c6-b89a-48aa-b943-b498be88fee9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:30 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 Nov 06 10:47:30 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:31 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535" returned: 0 in 0.578s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b687d4b7-7a6e-4738-9f60-093c270e81dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:31 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[742f7955-bebd-472f-8451-30953359398d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a9de7d3-8531-452b-b3fd-0a17f439b31b tempest-VolumesExtendTest-1234594248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a9de7d3-8531-452b-b3fd-0a17f439b31b tempest-VolumesExtendTest-1234594248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:31 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fffc6e-10cd-44d3-bb18-0820dc6d12bd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a9de7d3-8531-452b-b3fd-0a17f439b31b tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:31 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd Nov 06 10:47:31 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:31 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912 Nov 06 10:47:31 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:31 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a9de7d3-8531-452b-b3fd-0a17f439b31b tempest-VolumesExtendTest-1234594248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912" returned: 0 in 0.564s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:31 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a9de7d3-8531-452b-b3fd-0a17f439b31b tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a 2G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd" returned: 0 in 0.713s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:31 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 Nov 06 10:47:31 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:31 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:47:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Flow 'volume_create_manager' (98bddc42-564a-4a92-a483-ddde2c0d270c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287de0e3-d6ce-436c-81c5-41014147b534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a9de7d3-8531-452b-b3fd-0a17f439b31b tempest-VolumesExtendTest-1234594248 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a 2G" returned: 0 in 0.208s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a9de7d3-8531-452b-b3fd-0a17f439b31b tempest-VolumesExtendTest-1234594248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.837s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287de0e3-d6ce-436c-81c5-41014147b534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1890385735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a744dcc4-7c06-494d-9d8d-9504a569974d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8bfac7c1904e1db04f5f6f9731b385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:32Z,use_quota=True,user_id='e09615c1544840baaa8a4542b23cb26e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15003d2a-5046-4749-bb28-d925abc5d4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15003d2a-5046-4749-bb28-d925abc5d4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64aef710-54d9-40f6-8bad-76183792803f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64aef710-54d9-40f6-8bad-76183792803f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a744dcc4-7c06-494d-9d8d-9504a569974d', 'volume_name': 'volume-a744dcc4-7c06-494d-9d8d-9504a569974d', 'volume_size': 2}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9821e780-1810-4fe9-b6d5-741fe937c7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9821e780-1810-4fe9-b6d5-741fe937c7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4a5a92-543f-4009-af24-8e44360f4514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:32 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Volume a744dcc4-7c06-494d-9d8d-9504a569974d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a744dcc4-7c06-494d-9d8d-9504a569974d', 'volume_size': 2} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1890385735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a744dcc4-7c06-494d-9d8d-9504a569974d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8bfac7c1904e1db04f5f6f9731b385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:32Z,use_quota=True,user_id='e09615c1544840baaa8a4542b23cb26e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Creating volume a744dcc4-7c06-494d-9d8d-9504a569974d {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:47:32 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d 2147483648 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:32 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d 2147483648 Nov 06 10:47:32 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:32 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2a9de7d3-8531-452b-b3fd-0a17f439b31b tempest-VolumesExtendTest-1234594248 None] Extend volume completed successfully. Nov 06 10:47:32 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535" returned: 0 in 0.495s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:32 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535 Nov 06 10:47:32 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Acquiring lock "cinder-64ceff6f-f62f-445b-a29d-dfd8a24fbd4a-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Lock "cinder-64ceff6f-f62f-445b-a29d-dfd8a24fbd4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Acquiring lock "cinder-quobyte-89a7628e-144b-4d4e-aee4-e485dc28c912" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Lock "cinder-quobyte-89a7628e-144b-4d4e-aee4-e485dc28c912" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Acquiring lock "cinder-quobyte-64ceff6f-f62f-445b-a29d-dfd8a24fbd4a" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Lock "cinder-quobyte-64ceff6f-f62f-445b-a29d-dfd8a24fbd4a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Deleting offline snapshot 64ceff6f-f62f-445b-a29d-dfd8a24fbd4a of volume 89a7628e-144b-4d4e-aee4-e485dc28c912 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] snapshot_file for this snap is: volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b986a40e-888f-417c-93fd-0541f951fe7c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:32 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd.ee5bc5dc-33e6-4c37-8b11-ac8644804535" returned: 0 in 0.361s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Lock "cinder-quobyte-ee5bc5dc-33e6-4c37-8b11-ac8644804535" released by "_delete_snapshot" :: held 2.332s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" released by "delete_snapshot" :: held 2.370s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:32 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a Nov 06 10:47:32 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:32 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d 2147483648" returned: 0 in 0.683s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Created reservations ['3ef9d5f2-9fd8-4c30-ac95-ca27ffc7db68', 'f57627a9-643e-4c4d-b29c-0b6bd9b1249a', '287c18d8-999f-4858-9501-e76fca5baa92', '12521031-1cdc-43c9-a8b1-8adac1670f17'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:32 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d Nov 06 10:47:32 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:32 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Delete snapshot completed successfully. Nov 06 10:47:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-be164488-3e5e-4602-9c2f-ec10943e770a tempest-SnapshotsActionsTest-2134058876 None] Lock "cinder-ee5bc5dc-33e6-4c37-8b11-ac8644804535-delete_snapshot" released by "delete_snapshot" :: held 2.617s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:33 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a" returned: 0 in 0.443s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a7628e-144b-4d4e-aee4-e485dc28c912(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cca8cab-5dcd-4b7b-86dc-05401af43ac5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:33 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d" returned: 0 in 0.326s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4a5a92-543f-4009-af24-8e44360f4514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a744dcc4-7c06-494d-9d8d-9504a569974d', 'volume_size': 2}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253c7906-d314-4e84-bd5a-a8bdbb8ac2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:33 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Volume volume-a744dcc4-7c06-494d-9d8d-9504a569974d (a744dcc4-7c06-494d-9d8d-9504a569974d): created successfully Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253c7906-d314-4e84-bd5a-a8bdbb8ac2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Flow 'volume_create_manager' (98bddc42-564a-4a92-a483-ddde2c0d270c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:33 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a3f0a13a-12f5-421a-8dd4-101d725d741b tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Created volume successfully. Nov 06 10:47:33 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912 Nov 06 10:47:33 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:33 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912" returned: 0 in 0.418s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:33 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a Nov 06 10:47:33 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Acquiring lock "cinder-b687d4b7-7a6e-4738-9f60-093c270e81dd-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Lock "cinder-b687d4b7-7a6e-4738-9f60-093c270e81dd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Acquiring lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" acquired by "delete_volume" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3db457-0fb6-4675-8aa1-cb674b5d34ee]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:33 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd Nov 06 10:47:33 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:33 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a" returned: 0 in 0.393s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:33 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a Nov 06 10:47:33 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:34 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:34 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd" returned: 0 in 0.436s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912.64ceff6f-f62f-445b-a29d-dfd8a24fbd4a" returned: 0 in 0.313s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:34 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd Nov 06 10:47:34 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Lock "cinder-quobyte-64ceff6f-f62f-445b-a29d-dfd8a24fbd4a" released by "_delete_snapshot" :: held 1.772s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Lock "cinder-quobyte-89a7628e-144b-4d4e-aee4-e485dc28c912" released by "delete_snapshot" :: held 1.806s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Creating offline snapshot 1c340b71-9cef-48de-bfc1-105c83feb628 of volume a744dcc4-7c06-494d-9d8d-9504a569974d {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3694595a-6c34-4432-830a-eef25ab9dba6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Created reservations ['8904d9d6-602c-4179-943b-8173bc7815b8', '8c182410-bba2-4b5b-8aa0-6746f1573f2a', 'b0068333-1de6-4363-af1d-737f15e1563d', 'e4f3d1c0-bfa8-4b33-a1a7-0293a2e5b201'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:34 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d Nov 06 10:47:34 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:34 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Delete snapshot completed successfully. Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-00377426-5adc-48e6-97be-88bd1626a3a1 tempest-VolumesExtendTest-1234594248 None] Lock "cinder-64ceff6f-f62f-445b-a29d-dfd8a24fbd4a-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:34 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b687d4b7-7a6e-4738-9f60-093c270e81dd" returned: 0 in 0.286s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Lock "cinder-quobyte-b687d4b7-7a6e-4738-9f60-093c270e81dd" released by "delete_volume" :: held 0.789s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Created reservations ['1df0db7b-cf63-46bb-a299-f20c362b7a07', '03109a73-871d-4536-a5e7-27759f5885b3', '0844b107-49bb-4109-8c6a-1ca42403646e', 'f7d02382-5fb9-42a5-8bbb-d0b73c71c9d7'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Acquiring lock "cinder-89a7628e-144b-4d4e-aee4-e485dc28c912-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Lock "cinder-89a7628e-144b-4d4e-aee4-e485dc28c912-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:34 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:47:34 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Acquiring lock "cinder-quobyte-89a7628e-144b-4d4e-aee4-e485dc28c912" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Lock "cinder-quobyte-89a7628e-144b-4d4e-aee4-e485dc28c912" acquired by "delete_volume" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:34 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d" returned: 0 in 0.538s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628 2G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[859c028b-2bab-488b-be44-75f80705ddc1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:34 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628 2G Nov 06 10:47:34 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:35 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912 Nov 06 10:47:35 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:35 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.346s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:47:35 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Deleted volume successfully. Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eca8631f-a2f7-47d1-94e5-79e2df2a9566 tempest-SnapshotsActionsTest-2134058876 None] Lock "cinder-b687d4b7-7a6e-4738-9f60-093c270e81dd-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:35 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912" returned: 0 in 0.519s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:35 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628 2G" returned: 0 in 0.578s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a744dcc4-7c06-494d-9d8d-9504a569974d -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:35 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912 Nov 06 10:47:35 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:35 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a744dcc4-7c06-494d-9d8d-9504a569974d -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628 Nov 06 10:47:35 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "cinder-979eca52-77a4-4b4f-bc97-4b6e9991ebbd-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Lock "cinder-979eca52-77a4-4b4f-bc97-4b6e9991ebbd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "cinder-quobyte-979eca52-77a4-4b4f-bc97-4b6e9991ebbd" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Lock "cinder-quobyte-979eca52-77a4-4b4f-bc97-4b6e9991ebbd" acquired by "delete_volume" :: waited 0.028s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:35 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fd0ce8-837f-48fd-ba1a-d48f907df50f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-89a7628e-144b-4d4e-aee4-e485dc28c912" returned: 0 in 0.364s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Lock "cinder-quobyte-89a7628e-144b-4d4e-aee4-e485dc28c912" released by "delete_volume" :: held 0.999s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:35 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a744dcc4-7c06-494d-9d8d-9504a569974d -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628" returned: 0 in 0.382s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:35 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628 is being set with open permissions: ugo+rw Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:35 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628 Nov 06 10:47:35 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Created reservations ['31948644-f8e2-479f-9b97-903ee2200ad4', '8537893d-7ae9-4e00-b520-81b7f4b66cdc', 'aa3d7ac2-7177-4052-8c6f-a88a4ea162f7', '2da2c1fe-428e-4c5e-ac39-7494f33d24bb'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:35 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd Nov 06 10:47:35 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:36 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:47:36 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:47:36 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628" returned: 0 in 0.336s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:36 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:47:36 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:36 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.info Nov 06 10:47:36 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:36 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd" returned: 0 in 0.519s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:36 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd Nov 06 10:47:36 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:36 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.377s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:47:36 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Deleted volume successfully. Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-99751458-52c0-402d-9206-5065e8f3b32d tempest-VolumesExtendTest-1234594248 None] Lock "cinder-89a7628e-144b-4d4e-aee4-e485dc28c912-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:36 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.307s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 28 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:47:36 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.info" returned: 0 in 0.332s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:36 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.info is being set with open permissions: ugo+rw Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:36 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.info Nov 06 10:47:36 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:36 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-979eca52-77a4-4b4f-bc97-4b6e9991ebbd" returned: 0 in 0.332s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Lock "cinder-quobyte-979eca52-77a4-4b4f-bc97-4b6e9991ebbd" released by "delete_volume" :: held 0.905s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Created reservations ['549db71b-7c10-4d4c-9058-94d1528ab778', '7efc5da8-c277-45c4-b188-380833a01c92', '4440f3f1-a046-4a15-af6e-058263488afe', 'a0cd5725-11a9-4ea3-ba42-bc1516e26025'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:36 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:47:36 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:36 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.info" returned: 0 in 0.314s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.619s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:36 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a9d2429a-90f2-4648-9588-57d4d5270ca3 tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Create snapshot completed successfully Nov 06 10:47:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "cinder-461fa7f7-d0af-4cd7-a316-c5d47b67c249-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "cinder-461fa7f7-d0af-4cd7-a316-c5d47b67c249-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "cinder-quobyte-461fa7f7-d0af-4cd7-a316-c5d47b67c249" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "cinder-quobyte-461fa7f7-d0af-4cd7-a316-c5d47b67c249" acquired by "delete_volume" :: waited 0.027s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d870c34-42cc-48c6-835f-1da03a8e550e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:37 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.399s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:47:37 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Deleted volume successfully. Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-106af017-c4ec-4ede-a419-5b9832cf5d5f tempest-AttachVolumeNegativeTest-1480812843 None] Lock "cinder-979eca52-77a4-4b4f-bc97-4b6e9991ebbd-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:37 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249 Nov 06 10:47:37 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Acquiring lock "cinder-1c340b71-9cef-48de-bfc1-105c83feb628-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "cinder-1c340b71-9cef-48de-bfc1-105c83feb628-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Acquiring lock "cinder-quobyte-a744dcc4-7c06-494d-9d8d-9504a569974d" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "cinder-quobyte-a744dcc4-7c06-494d-9d8d-9504a569974d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Acquiring lock "cinder-quobyte-1c340b71-9cef-48de-bfc1-105c83feb628" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:37 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249" returned: 0 in 0.499s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "cinder-quobyte-1c340b71-9cef-48de-bfc1-105c83feb628" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Deleting offline snapshot 1c340b71-9cef-48de-bfc1-105c83feb628 of volume a744dcc4-7c06-494d-9d8d-9504a569974d {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:47:37 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249 Nov 06 10:47:37 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] snapshot_file for this snap is: volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bf4ec9-1494-44df-a576-f2e7d47bb02f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:37 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628 Nov 06 10:47:37 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:37 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-461fa7f7-d0af-4cd7-a316-c5d47b67c249" returned: 0 in 0.349s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "cinder-quobyte-461fa7f7-d0af-4cd7-a316-c5d47b67c249" released by "delete_volume" :: held 0.917s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Created reservations ['6f3ec3d9-0a6b-45b9-91d5-50a36f8f6cb3', 'd8075912-2bb3-42d1-97e3-5936d798aa75', 'a5c50973-39e4-4f56-aa98-f1efcd708b69', '64486535-bed9-43cb-8576-bd591a996af5'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:38 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628" returned: 0 in 0.540s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a744dcc4-7c06-494d-9d8d-9504a569974d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a99341-b1fb-463e-aa65-67b8069fe3a8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:38 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:47:38 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:38 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d Nov 06 10:47:38 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:38 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.373s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:47:38 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Deleted volume successfully. Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-09759459-af94-468c-b075-46ee90823779 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "cinder-461fa7f7-d0af-4cd7-a316-c5d47b67c249-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:38 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d" returned: 0 in 0.464s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:38 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628 Nov 06 10:47:38 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:39 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628" returned: 0 in 0.379s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:39 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628 Nov 06 10:47:39 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:39 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d.1c340b71-9cef-48de-bfc1-105c83feb628" returned: 0 in 0.350s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "cinder-quobyte-1c340b71-9cef-48de-bfc1-105c83feb628" released by "_delete_snapshot" :: held 1.924s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "cinder-quobyte-a744dcc4-7c06-494d-9d8d-9504a569974d" released by "delete_snapshot" :: held 1.976s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "cinder-05d48567-14cd-402b-9010-06696b0595fd-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "cinder-05d48567-14cd-402b-9010-06696b0595fd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "cinder-quobyte-05d48567-14cd-402b-9010-06696b0595fd" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:39 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Created reservations ['c3824367-19bd-4919-9b06-83aa22d02cf3', 'e4bf9d0c-8183-4277-b820-f5b4e2e013c9', '75a1d027-1f1e-43b0-b18d-51a5856fc6a3', 'be8ed1ac-555f-45f1-a7b4-088515632327'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "cinder-quobyte-05d48567-14cd-402b-9010-06696b0595fd" acquired by "delete_volume" :: waited 0.025s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:39 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2b8b3d-019c-4875-8c88-7c22f64727a4]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-05d48567-14cd-402b-9010-06696b0595fd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:39 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Delete snapshot completed successfully. Nov 06 10:47:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-43d0321e-1072-4ecf-ab83-3c47602a022c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "cinder-1c340b71-9cef-48de-bfc1-105c83feb628-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:39 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-05d48567-14cd-402b-9010-06696b0595fd Nov 06 10:47:39 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:40 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-05d48567-14cd-402b-9010-06696b0595fd" returned: 0 in 0.398s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-05d48567-14cd-402b-9010-06696b0595fd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:40 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-05d48567-14cd-402b-9010-06696b0595fd Nov 06 10:47:40 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:40 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-05d48567-14cd-402b-9010-06696b0595fd" returned: 0 in 0.267s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "cinder-quobyte-05d48567-14cd-402b-9010-06696b0595fd" released by "delete_volume" :: held 0.727s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Created reservations ['7d7d07b4-7942-4906-969f-ba247eba929b', 'c33481da-025c-4e9b-99ac-a1a6ea594c8b', '59f25ffb-9d42-4b44-aa29-1e7be322de0b', 'e304eee3-59be-482b-886d-81dfdb461c0c'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:40 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:47:40 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:40 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.296s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:47:40 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Deleted volume successfully. Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Acquiring lock "cinder-a744dcc4-7c06-494d-9d8d-9504a569974d-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-224c7819-1e71-4413-8daf-9391f970f726 tempest-AttachVolumeNegativeTest-1480812843 None] Lock "cinder-05d48567-14cd-402b-9010-06696b0595fd-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "cinder-a744dcc4-7c06-494d-9d8d-9504a569974d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Acquiring lock "cinder-quobyte-a744dcc4-7c06-494d-9d8d-9504a569974d" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "cinder-quobyte-a744dcc4-7c06-494d-9d8d-9504a569974d" acquired by "delete_volume" :: waited 0.026s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f816c4-163f-43be-9dc5-452a70d20b9f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:41 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d Nov 06 10:47:41 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:41 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d" returned: 0 in 0.460s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:41 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d Nov 06 10:47:41 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Flow 'volume_create_manager' (83889726-78b6-4cb0-a536-59c0c4bba77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1439421-6a9d-4e6d-8804-0340e36f3ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1439421-6a9d-4e6d-8804-0340e36f3ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1155107634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b161cff-c7d0-4250-8693-f451d027ac5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777606a9e4914791bfd0b2401930caca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:42Z,use_quota=True,user_id='ca17c390e5b1493bab4989456b37887f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bd9d6a-4235-42b4-b962-333418057ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bd9d6a-4235-42b4-b962-333418057ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81539275-a13c-4fd9-a493-5406a688715c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81539275-a13c-4fd9-a493-5406a688715c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b161cff-c7d0-4250-8693-f451d027ac5d', 'volume_name': 'volume-5b161cff-c7d0-4250-8693-f451d027ac5d', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61e2781-3001-45c9-998c-9a8cc8db0f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61e2781-3001-45c9-998c-9a8cc8db0f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab72b0b-5138-4a71-8e82-953f699d2225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:41 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Volume 5b161cff-c7d0-4250-8693-f451d027ac5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b161cff-c7d0-4250-8693-f451d027ac5d', 'volume_size': 1} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1155107634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b161cff-c7d0-4250-8693-f451d027ac5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777606a9e4914791bfd0b2401930caca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:42Z,use_quota=True,user_id='ca17c390e5b1493bab4989456b37887f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Creating volume 5b161cff-c7d0-4250-8693-f451d027ac5d {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:47:41 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b161cff-c7d0-4250-8693-f451d027ac5d 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:41 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b161cff-c7d0-4250-8693-f451d027ac5d 1073741824 Nov 06 10:47:41 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:41 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a744dcc4-7c06-494d-9d8d-9504a569974d" returned: 0 in 0.297s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:41 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "cinder-quobyte-a744dcc4-7c06-494d-9d8d-9504a569974d" released by "delete_volume" :: held 0.864s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Created reservations ['81fa31bb-be22-4b98-aaee-2b1b82cbad6c', '619d11aa-1415-4827-8d19-2f3f33bc8254', 'e852440d-d9a1-4633-b939-8cb583731bdd', 'e7fe0b38-4b4a-4c2f-b46e-4e8effb8dbaf'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:42 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:47:42 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:42 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b161cff-c7d0-4250-8693-f451d027ac5d 1073741824" returned: 0 in 0.604s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b161cff-c7d0-4250-8693-f451d027ac5d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:42 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b161cff-c7d0-4250-8693-f451d027ac5d Nov 06 10:47:42 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:42 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.375s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:47:42 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Deleted volume successfully. Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7eabf760-b818-4fc0-a155-b5d54825898c tempest-VolumesSnapshotNegativeTestJSON-1969112956 None] Lock "cinder-a744dcc4-7c06-494d-9d8d-9504a569974d-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:42 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b161cff-c7d0-4250-8693-f451d027ac5d" returned: 0 in 0.284s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab72b0b-5138-4a71-8e82-953f699d2225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b161cff-c7d0-4250-8693-f451d027ac5d', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737be301-f4ae-42f2-afbc-59a6ae8251fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:42 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Volume volume-5b161cff-c7d0-4250-8693-f451d027ac5d (5b161cff-c7d0-4250-8693-f451d027ac5d): created successfully Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737be301-f4ae-42f2-afbc-59a6ae8251fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Flow 'volume_create_manager' (83889726-78b6-4cb0-a536-59c0c4bba77d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:42 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a6d0aef0-d7f5-4004-aff8-4f9529e41f4c tempest-VolumesNegativeTest-119780649 None] Created volume successfully. Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Flow 'volume_create_manager' (a4c0fc43-d50f-4aee-a4b6-c1d995cc4006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d97cbe-428e-4f34-a8b1-bb375a0cbe45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d97cbe-428e-4f34-a8b1-bb375a0cbe45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1823654512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3222eb9a-9c9e-41a7-b8f5-b02bb17c4461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab42345fea4109b49ec7cbd8d60226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:52Z,use_quota=True,user_id='0d48fc3bcf5244cf8a2712529d857b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14dd17ce-ea79-4357-8646-18934addc1eb),volume_type_id=14dd17ce-ea79-4357-8646-18934addc1eb)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3c1992-cd6c-467f-b7fa-16c73a446790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3c1992-cd6c-467f-b7fa-16c73a446790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a95093-31e2-4189-a7d5-1cddc9f587bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a95093-31e2-4189-a7d5-1cddc9f587bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3222eb9a-9c9e-41a7-b8f5-b02bb17c4461', 'volume_name': 'volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7073d60-3339-4c98-a425-a6aa972db47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7073d60-3339-4c98-a425-a6aa972db47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31da435-0308-4c07-96b5-999226a2c09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:51 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Volume 3222eb9a-9c9e-41a7-b8f5-b02bb17c4461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461', 'volume_size': 1} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1823654512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3222eb9a-9c9e-41a7-b8f5-b02bb17c4461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab42345fea4109b49ec7cbd8d60226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:47:52Z,use_quota=True,user_id='0d48fc3bcf5244cf8a2712529d857b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14dd17ce-ea79-4357-8646-18934addc1eb),volume_type_id=14dd17ce-ea79-4357-8646-18934addc1eb)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Creating volume 3222eb9a-9c9e-41a7-b8f5-b02bb17c4461 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:47:51 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:47:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:51 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461 1073741824 Nov 06 10:47:51 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:52 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461 1073741824" returned: 0 in 0.609s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:52 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461 Nov 06 10:47:52 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:53 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461" returned: 0 in 0.650s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:47:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31da435-0308-4c07-96b5-999226a2c09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99e96f1-ee0f-49a2-9d04-0eb48fdb967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:47:53 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Volume volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461 (3222eb9a-9c9e-41a7-b8f5-b02bb17c4461): created successfully Nov 06 10:47:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99e96f1-ee0f-49a2-9d04-0eb48fdb967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:47:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Flow 'volume_create_manager' (a4c0fc43-d50f-4aee-a4b6-c1d995cc4006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:47:53 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2a4d9763-8559-471a-a71c-6b440a779f25 tempest-VolumeTypesAccessTest-515120269 None] Created volume successfully. Nov 06 10:47:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Acquiring lock "cinder-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Lock "cinder-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Acquiring lock "cinder-quobyte-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:47:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Lock "cinder-quobyte-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461" acquired by "delete_volume" :: waited 0.032s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:47:54 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8a84d2-2a0f-4435-ba4c-8097746edad4]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:47:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:54 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461 Nov 06 10:47:54 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:54 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461" returned: 0 in 0.600s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:54 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461 Nov 06 10:47:54 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:55 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461" returned: 0 in 0.435s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Lock "cinder-quobyte-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461" released by "delete_volume" :: held 1.160s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:47:55 devstack cinder-volume[86819]: WARNING cinder.quota [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-590597129 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-590597129, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:47:55 devstack cinder-volume[86819]: WARNING cinder.quota [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-590597129 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-590597129, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:47:55 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Created reservations ['58689f33-7e6b-4c3d-ac3f-e62ba8a73f27', '3b293c35-4dfa-4473-b895-d25a944b9973', 'ac2bf0b3-71ea-4a9d-ab3d-16acdaf81cab', '5ce3fd00-0401-4879-804d-f0c8f74dd901'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:47:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:47:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:47:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:47:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:47:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:47:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:47:55 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:47:55 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:47:56 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Nov 06 10:47:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.380s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:47:56 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:47:56 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Deleted volume successfully. Nov 06 10:47:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4459cb1b-bc10-41b8-8190-c93fce5ca013 tempest-VolumeTypesAccessTest-515120269 None] Lock "cinder-3222eb9a-9c9e-41a7-b8f5-b02bb17c4461-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:00 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=168,cinder:UPDATE=206,cinder:DELETE=18,cinder:INSERT=51 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:48:00 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-74edc86c-9b09-4eba-8b0c-d43e9acaf08a tempest-GroupSnapshotsTest-28490446 None] Group tempest-GroupSnapshotsTest-Group-370500508: creating Nov 06 10:48:00 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=200,cinder:SELECT=164,cinder:INSERT=61,cinder:DELETE=15 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:48:00 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-74edc86c-9b09-4eba-8b0c-d43e9acaf08a tempest-GroupSnapshotsTest-28490446 None] Group tempest-GroupSnapshotsTest-Group-370500508: created successfully Nov 06 10:48:00 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-74edc86c-9b09-4eba-8b0c-d43e9acaf08a tempest-GroupSnapshotsTest-28490446 None] Create group completed successfully. Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Flow 'volume_create_manager' (deddb2ea-07c1-49b6-8a99-3381d97b57b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40498d4-4ce6-4719-98d8-af477bdd5e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40498d4-4ce6-4719-98d8-af477bdd5e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1412528457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97fa989a-564f-458b-8d4c-a7a92ecd19cb,host='devstack@QuobyteHD#QuobyteHD',id=ccefa255-0592-417b-a830-011a444f4e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f67b2c63554cb19528268c54bd338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:48:02Z,use_quota=True,user_id='7c5387d14e8d4dafadb7405be37775d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab893e53-a4f3-47a9-9253-4a1ffbbbb137),volume_type_id=ab893e53-a4f3-47a9-9253-4a1ffbbbb137)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1d1c57-b6f6-41a0-835b-0d516bea966f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1d1c57-b6f6-41a0-835b-0d516bea966f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc001256-165a-4b6f-b62f-5d7bd58188cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc001256-165a-4b6f-b62f-5d7bd58188cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccefa255-0592-417b-a830-011a444f4e30', 'volume_name': 'volume-ccefa255-0592-417b-a830-011a444f4e30', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (544ce29a-d1c9-4aaa-a7ca-79492dae5469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (544ce29a-d1c9-4aaa-a7ca-79492dae5469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77728f6a-ca27-4716-95cb-5ac7a58546ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:02 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Volume ccefa255-0592-417b-a830-011a444f4e30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccefa255-0592-417b-a830-011a444f4e30', 'volume_size': 1} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=97fa989a-564f-458b-8d4c-a7a92ecd19cb,created_at=2026-11-06T09:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1412528457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97fa989a-564f-458b-8d4c-a7a92ecd19cb,host='devstack@QuobyteHD#QuobyteHD',id=ccefa255-0592-417b-a830-011a444f4e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f67b2c63554cb19528268c54bd338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:48:02Z,use_quota=True,user_id='7c5387d14e8d4dafadb7405be37775d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab893e53-a4f3-47a9-9253-4a1ffbbbb137),volume_type_id=ab893e53-a4f3-47a9-9253-4a1ffbbbb137)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Creating volume ccefa255-0592-417b-a830-011a444f4e30 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:48:02 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:02 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 1073741824 Nov 06 10:48:02 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:02 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 1073741824" returned: 0 in 0.508s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:02 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 Nov 06 10:48:02 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:03 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30" returned: 0 in 0.328s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:48:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77728f6a-ca27-4716-95cb-5ac7a58546ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccefa255-0592-417b-a830-011a444f4e30', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6414965e-d66f-4277-a9cd-78f8b6ed8ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:03 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Volume volume-ccefa255-0592-417b-a830-011a444f4e30 (ccefa255-0592-417b-a830-011a444f4e30): created successfully Nov 06 10:48:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6414965e-d66f-4277-a9cd-78f8b6ed8ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Flow 'volume_create_manager' (deddb2ea-07c1-49b6-8a99-3381d97b57b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:48:03 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2bc1df7b-2569-4347-bc4d-5b618152994f tempest-GroupSnapshotsTest-28490446 None] Created volume successfully. Nov 06 10:48:03 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] GroupSnapshot a6bcec5b-2a91-4b44-abd9-2d693aad2693: creating. Nov 06 10:48:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] Group snapshot a6bcec5b-2a91-4b44-abd9-2d693aad2693: creating. {{(pid=86819) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 10:48:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] Creating offline snapshot df69faa2-d199-4dcd-a8c0-621b7c133996 of volume ccefa255-0592-417b-a830-011a444f4e30 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:48:03 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[936585c3-f6a3-4fc7-bc2f-0f430b5f21c2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:04 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 Nov 06 10:48:04 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:04 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30" returned: 0 in 0.575s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:04 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 1G Nov 06 10:48:04 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:04 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 1G" returned: 0 in 0.542s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccefa255-0592-417b-a830-011a444f4e30 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:05 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccefa255-0592-417b-a830-011a444f4e30 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 Nov 06 10:48:05 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:05 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccefa255-0592-417b-a830-011a444f4e30 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996" returned: 0 in 0.476s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:05 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 10:48:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:05 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 Nov 06 10:48:05 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:05 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996" returned: 0 in 0.290s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:05 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.info Nov 06 10:48:05 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:06 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.info" returned: 0 in 0.417s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:06 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 10:48:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:06 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.info Nov 06 10:48:06 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:06 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.info" returned: 0 in 0.312s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.744s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:06 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-18c2b684-e298-446d-9127-a1125f0d3bbb tempest-GroupSnapshotsTest-28490446 None] group_snapshot a6bcec5b-2a91-4b44-abd9-2d693aad2693: created successfully Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "cinder-quobyte-df69faa2-d199-4dcd-a8c0-621b7c133996-f18fbd8d-96e0-4d39-8894-af1b4fb47b66" by "_create_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-df69faa2-d199-4dcd-a8c0-621b7c133996-f18fbd8d-96e0-4d39-8894-af1b4fb47b66" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Creating volume f18fbd8d-96e0-4d39-8894-af1b4fb47b66 from snapshot df69faa2-d199-4dcd-a8c0-621b7c133996 {{(pid=86819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "cinder-quobyte-f18fbd8d-96e0-4d39-8894-af1b4fb47b66" by "_copy_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-f18fbd8d-96e0-4d39-8894-af1b4fb47b66" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] snapshot: df69faa2-d199-4dcd-a8c0-621b7c133996, volume: f18fbd8d-96e0-4d39-8894-af1b4fb47b66, {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d393780e-a39c-4311-8c90-a87bf78ec4d8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:08 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 Nov 06 10:48:08 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:08 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996" returned: 0 in 0.493s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccefa255-0592-417b-a830-011a444f4e30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82dfd47-b996-4c80-a4f4-a205e3de6776]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:09 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 Nov 06 10:48:09 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:09 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30" returned: 0 in 0.684s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] will copy from snapshot at /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 10:48:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Creating direct copy from snapshot {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 10:48:09 devstack cinder-volume[86819]: DEBUG cinder.utils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Path /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f18fbd8d-96e0-4d39-8894-af1b4fb47b66 not found in is_blk_device check {{(pid=86819) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 10:48:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f18fbd8d-96e0-4d39-8894-af1b4fb47b66 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:09 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f18fbd8d-96e0-4d39-8894-af1b4fb47b66 Nov 06 10:48:09 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Acquiring lock "cinder-5b161cff-c7d0-4250-8693-f451d027ac5d-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Lock "cinder-5b161cff-c7d0-4250-8693-f451d027ac5d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Acquiring lock "cinder-quobyte-5b161cff-c7d0-4250-8693-f451d027ac5d" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Lock "cinder-quobyte-5b161cff-c7d0-4250-8693-f451d027ac5d" acquired by "delete_volume" :: waited 0.034s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:10 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bf9f8a-023f-4090-a0f5-0d9c5176b137]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b161cff-c7d0-4250-8693-f451d027ac5d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:10 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b161cff-c7d0-4250-8693-f451d027ac5d Nov 06 10:48:10 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:11 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b161cff-c7d0-4250-8693-f451d027ac5d" returned: 0 in 0.804s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b161cff-c7d0-4250-8693-f451d027ac5d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:11 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b161cff-c7d0-4250-8693-f451d027ac5d Nov 06 10:48:11 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:12 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b161cff-c7d0-4250-8693-f451d027ac5d" returned: 0 in 0.619s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Lock "cinder-quobyte-5b161cff-c7d0-4250-8693-f451d027ac5d" released by "delete_volume" :: held 1.537s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:12 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Created reservations ['47e4b9e5-e59a-44db-91ee-f4b576ac5d4a', '1b858c37-0960-4401-b00d-05f982bf9018', 'cc0d04e3-8ec2-4ce6-a97e-546a7baa0c07', '4671b592-3d44-41b7-9366-6773d424f3e4'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:48:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:48:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:48:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:12 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:48:12 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:13 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.798s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:13 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:48:13 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Deleted volume successfully. Nov 06 10:48:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5693bf1a-08ba-43b9-9568-a7890017915e tempest-VolumesNegativeTest-119780649 None] Lock "cinder-5b161cff-c7d0-4250-8693-f451d027ac5d-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:19 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f18fbd8d-96e0-4d39-8894-af1b4fb47b66" returned: 0 in 9.966s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:19 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Image conversion details: src /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30, size 1024.00 MB, duration 9.97 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f18fbd8d-96e0-4d39-8894-af1b4fb47b66 {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:48:19 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Converted 1024.00 MB image at 102.74 MB/s Nov 06 10:48:19 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f18fbd8d-96e0-4d39-8894-af1b4fb47b66 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 10:48:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f18fbd8d-96e0-4d39-8894-af1b4fb47b66 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:19 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f18fbd8d-96e0-4d39-8894-af1b4fb47b66 Nov 06 10:48:19 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:19 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f18fbd8d-96e0-4d39-8894-af1b4fb47b66" returned: 0 in 0.277s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-f18fbd8d-96e0-4d39-8894-af1b4fb47b66" released by "_copy_volume_from_snapshot" :: held 11.568s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-df69faa2-d199-4dcd-a8c0-621b7c133996-f18fbd8d-96e0-4d39-8894-af1b4fb47b66" released by "_create_volume_from_snapshot" :: held 11.665s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.689s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:19 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-56eeea35-aff1-4102-8162-1b71ece59959 tempest-GroupSnapshotsTest-28490446 None] Create group from source-snapshot-a6bcec5b-2a91-4b44-abd9-2d693aad2693 completed successfully. Nov 06 10:48:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "cinder-quobyte-f18fbd8d-96e0-4d39-8894-af1b4fb47b66" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-f18fbd8d-96e0-4d39-8894-af1b4fb47b66" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:21 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[677d8e66-9583-49c4-9baa-d5a58ba2f84c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f18fbd8d-96e0-4d39-8894-af1b4fb47b66 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:21 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f18fbd8d-96e0-4d39-8894-af1b4fb47b66 Nov 06 10:48:21 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:21 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f18fbd8d-96e0-4d39-8894-af1b4fb47b66" returned: 0 in 0.434s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f18fbd8d-96e0-4d39-8894-af1b4fb47b66 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:21 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f18fbd8d-96e0-4d39-8894-af1b4fb47b66 Nov 06 10:48:21 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:21 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f18fbd8d-96e0-4d39-8894-af1b4fb47b66" returned: 0 in 0.291s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-f18fbd8d-96e0-4d39-8894-af1b4fb47b66" released by "delete_volume" :: held 0.806s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Created reservations ['0435b705-5796-46dd-934d-27d53ac82ec8'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:48:22 devstack cinder-volume[86819]: WARNING cinder.quota [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2054089373 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2054089373, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:48:22 devstack cinder-volume[86819]: WARNING cinder.quota [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2054089373 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2054089373, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Created reservations ['2783309f-6fa7-49fc-ba6b-28bbba12485c', '30a38cf8-85f1-41b8-aa24-c61fd0328f31', 'f9261ce9-0200-4fb8-b26e-0a072d35d36a', '7527a348-eec5-4ca8-b292-2603fa8e1b7d'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:22 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:48:22 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Flow 'volume_create_manager' (9cf329c2-2be6-4eb4-bd43-aa5d702cc0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a60e6b8-14b0-41f2-a140-c80f41149651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a60e6b8-14b0-41f2-a140-c80f41149651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1807379258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da30797c-4484-47e4-ab47-1d9f162e18a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faaed80532a24a65a99675fbfd63dcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:48:22Z,use_quota=True,user_id='1ce9c0d59b3b4a4c80728bf1f659af0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db408d5-d340-40ab-8b4e-a3ea1d2f2e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db408d5-d340-40ab-8b4e-a3ea1d2f2e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988c8242-8969-41a0-8f4e-0c4ca1782a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988c8242-8969-41a0-8f4e-0c4ca1782a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da30797c-4484-47e4-ab47-1d9f162e18a5', 'volume_name': 'volume-da30797c-4484-47e4-ab47-1d9f162e18a5', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776e595c-47cd-4e66-b367-6ef2bea39d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776e595c-47cd-4e66-b367-6ef2bea39d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d46e081-7137-4de5-a336-686a368e7a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:22 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Volume da30797c-4484-47e4-ab47-1d9f162e18a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da30797c-4484-47e4-ab47-1d9f162e18a5', 'volume_size': 1} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1807379258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da30797c-4484-47e4-ab47-1d9f162e18a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faaed80532a24a65a99675fbfd63dcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:48:22Z,use_quota=True,user_id='1ce9c0d59b3b4a4c80728bf1f659af0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Creating volume da30797c-4484-47e4-ab47-1d9f162e18a5 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:48:22 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:22 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5 1073741824 Nov 06 10:48:22 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:22 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.326s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:22 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:48:22 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-dc9761f8-a997-4294-9f3f-95455f076908 tempest-GroupSnapshotsTest-28490446 None] Delete group completed successfully. Nov 06 10:48:23 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5 1073741824" returned: 0 in 0.561s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:23 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5 Nov 06 10:48:23 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:23 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5" returned: 0 in 0.268s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d46e081-7137-4de5-a336-686a368e7a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da30797c-4484-47e4-ab47-1d9f162e18a5', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5061ac6-e8a7-4ef5-86e1-212b6475a7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] group_snapshot a6bcec5b-2a91-4b44-abd9-2d693aad2693: deleting Nov 06 10:48:23 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Volume volume-da30797c-4484-47e4-ab47-1d9f162e18a5 (da30797c-4484-47e4-ab47-1d9f162e18a5): created successfully Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5061ac6-e8a7-4ef5-86e1-212b6475a7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Flow 'volume_create_manager' (9cf329c2-2be6-4eb4-bd43-aa5d702cc0d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:48:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-49788446-3580-4e18-a4e7-b5ad72acf01e tempest-VolumesSnapshotListTestJSON-1083707314 None] Created volume successfully. Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] group_snapshot a6bcec5b-2a91-4b44-abd9-2d693aad2693: deleting {{(pid=86819) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "cinder-quobyte-ccefa255-0592-417b-a830-011a444f4e30" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-ccefa255-0592-417b-a830-011a444f4e30" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "cinder-quobyte-df69faa2-d199-4dcd-a8c0-621b7c133996" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-df69faa2-d199-4dcd-a8c0-621b7c133996" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] Deleting offline snapshot df69faa2-d199-4dcd-a8c0-621b7c133996 of volume ccefa255-0592-417b-a830-011a444f4e30 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] snapshot_file for this snap is: volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[55eec1b0-d5b5-4f50-877b-66e1e3b7acdc]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:23 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 Nov 06 10:48:23 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Flow 'volume_create_manager' (41c28489-cebc-4f0e-990c-2963c1308485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:48:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592de9a9-bd29-4627-afc2-300c6083c3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592de9a9-bd29-4627-afc2-300c6083c3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-597261445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1cb867-a798-43dd-985b-2d01b4760112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8572cbf5d4422a8b7b4f9352b3db51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:48:24Z,use_quota=True,user_id='b7cf99f1ae8448ddbae10137b50a399b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23e8b28c-30cd-4f6e-a4cc-7a14208e7ee8),volume_type_id=23e8b28c-30cd-4f6e-a4cc-7a14208e7ee8)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598ee948-612d-4d2e-a1ad-71b8e62bc0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598ee948-612d-4d2e-a1ad-71b8e62bc0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a88fe77-189d-4456-9ad1-897dc4ee3e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a88fe77-189d-4456-9ad1-897dc4ee3e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f1cb867-a798-43dd-985b-2d01b4760112', 'volume_name': 'volume-9f1cb867-a798-43dd-985b-2d01b4760112', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09231034-e146-4fa7-8279-46ee4ef34b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09231034-e146-4fa7-8279-46ee4ef34b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a539dc1-1e24-452e-99c7-b1ea68879bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:24 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Volume 9f1cb867-a798-43dd-985b-2d01b4760112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f1cb867-a798-43dd-985b-2d01b4760112', 'volume_size': 1} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-597261445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1cb867-a798-43dd-985b-2d01b4760112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8572cbf5d4422a8b7b4f9352b3db51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:48:24Z,use_quota=True,user_id='b7cf99f1ae8448ddbae10137b50a399b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23e8b28c-30cd-4f6e-a4cc-7a14208e7ee8),volume_type_id=23e8b28c-30cd-4f6e-a4cc-7a14208e7ee8)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Creating volume 9f1cb867-a798-43dd-985b-2d01b4760112 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:48:24 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9f1cb867-a798-43dd-985b-2d01b4760112 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:24 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9f1cb867-a798-43dd-985b-2d01b4760112 1073741824 Nov 06 10:48:24 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:24 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996" returned: 0 in 0.563s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccefa255-0592-417b-a830-011a444f4e30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7f72b2-ecec-409f-9dfc-597c5e4b1902]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:48:24 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 Nov 06 10:48:24 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Flow 'volume_create_manager' (1b66ec55-d2c7-429d-a1f3-632390853782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9a4649-2987-4847-b4db-f5a38067d274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9a4649-2987-4847-b4db-f5a38067d274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-352803487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15950b55-596d-4f59-af76-49734841e657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8572cbf5d4422a8b7b4f9352b3db51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:48:24Z,use_quota=True,user_id='b7cf99f1ae8448ddbae10137b50a399b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a91a96c-521f-44c5-a445-d1ea2389bcb8),volume_type_id=4a91a96c-521f-44c5-a445-d1ea2389bcb8)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abefe64f-548c-4cd4-a975-2f50c02f52c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abefe64f-548c-4cd4-a975-2f50c02f52c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd547b60-321e-4b4d-a92d-b20d97f7f51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd547b60-321e-4b4d-a92d-b20d97f7f51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15950b55-596d-4f59-af76-49734841e657', 'volume_name': 'volume-15950b55-596d-4f59-af76-49734841e657', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc060046-e18f-4e6a-bd34-1943bde525d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc060046-e18f-4e6a-bd34-1943bde525d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a202ca8-eae2-4260-bf1e-fd9f357b51a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:24 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Volume 15950b55-596d-4f59-af76-49734841e657: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15950b55-596d-4f59-af76-49734841e657', 'volume_size': 1} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:24 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9f1cb867-a798-43dd-985b-2d01b4760112 1073741824" returned: 0 in 0.635s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9f1cb867-a798-43dd-985b-2d01b4760112 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:24 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9f1cb867-a798-43dd-985b-2d01b4760112 Nov 06 10:48:24 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:25 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9f1cb867-a798-43dd-985b-2d01b4760112" returned: 0 in 0.316s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.438s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-352803487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15950b55-596d-4f59-af76-49734841e657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8572cbf5d4422a8b7b4f9352b3db51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:48:24Z,use_quota=True,user_id='b7cf99f1ae8448ddbae10137b50a399b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a91a96c-521f-44c5-a445-d1ea2389bcb8),volume_type_id=4a91a96c-521f-44c5-a445-d1ea2389bcb8)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Creating volume 15950b55-596d-4f59-af76-49734841e657 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:48:25 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-15950b55-596d-4f59-af76-49734841e657 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a539dc1-1e24-452e-99c7-b1ea68879bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f1cb867-a798-43dd-985b-2d01b4760112', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6a457d-d540-489b-a4d6-c2df5e0e3f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:25 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-15950b55-596d-4f59-af76-49734841e657 1073741824 Nov 06 10:48:25 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:25 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Volume volume-9f1cb867-a798-43dd-985b-2d01b4760112 (9f1cb867-a798-43dd-985b-2d01b4760112): created successfully Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6a457d-d540-489b-a4d6-c2df5e0e3f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Flow 'volume_create_manager' (41c28489-cebc-4f0e-990c-2963c1308485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:48:25 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30" returned: 0 in 0.872s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:25 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b6adc243-febc-427c-8a62-f8a02c63f0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Created volume successfully. Nov 06 10:48:25 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 Nov 06 10:48:25 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Flow 'volume_create_manager' (920b2ba9-4609-4674-978e-35fe10d4ef79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fc36b7-9095-47cc-b447-a699278acb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fc36b7-9095-47cc-b447-a699278acb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1344420382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc528370-0c1d-42a7-beb7-9a80bbb576c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8572cbf5d4422a8b7b4f9352b3db51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:48:25Z,use_quota=True,user_id='b7cf99f1ae8448ddbae10137b50a399b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0cf2b23-ad41-491c-87d8-00983c4d651c),volume_type_id=a0cf2b23-ad41-491c-87d8-00983c4d651c)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c23d8b-020c-4dd0-bf10-0dacc58a948a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c23d8b-020c-4dd0-bf10-0dacc58a948a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0085bc-6e48-4f59-9e70-15928c7ff96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.image.glance [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Creating Keystone auth plugin from conf {{(pid=86819) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 10:48:25 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-15950b55-596d-4f59-af76-49734841e657 1073741824" returned: 0 in 0.498s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:25 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996" returned: 0 in 0.437s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:25 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996 Nov 06 10:48:25 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-15950b55-596d-4f59-af76-49734841e657 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:25 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-15950b55-596d-4f59-af76-49734841e657 Nov 06 10:48:25 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0085bc-6e48-4f59-9e70-15928c7ff96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dc528370-0c1d-42a7-beb7-9a80bbb576c4', 'volume_name': 'volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4', 'volume_size': 1, 'image_id': 'b19564eb-4671-4660-a545-87f7a8e65b4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b19564eb-4671-4660-a545-87f7a8e65b4d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1783217607', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ef8572cbf5d4422a8b7b4f9352b3db51', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b19564eb-4671-4660-a545-87f7a8e65b4d', 'created_at': datetime.datetime(2026, 11, 6, 9, 48, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 48, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b19564eb-4671-4660-a545-87f7a8e65b4d/file', 'properties': {}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0305c6-b4f8-497d-998e-31cfb82c7b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0305c6-b4f8-497d-998e-31cfb82c7b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd97ae7-b283-4bda-bb74-4b8d24b21486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:26 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Volume dc528370-0c1d-42a7-beb7-9a80bbb576c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4', 'volume_size': 1, 'image_id': 'b19564eb-4671-4660-a545-87f7a8e65b4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b19564eb-4671-4660-a545-87f7a8e65b4d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1783217607', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ef8572cbf5d4422a8b7b4f9352b3db51', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b19564eb-4671-4660-a545-87f7a8e65b4d', 'created_at': datetime.datetime(2026, 11, 6, 9, 48, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 48, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b19564eb-4671-4660-a545-87f7a8e65b4d/file', 'properties': {}}, 'image_service': } Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Trying to clone dc528370-0c1d-42a7-beb7-9a80bbb576c4 from image b19564eb-4671-4660-a545-87f7a8e65b4d at location (None, [{'url': 'file:///opt/stack/data/glance/images/b19564eb-4671-4660-a545-87f7a8e65b4d', 'metadata': {}}]). {{(pid=86819) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 10:48:26 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30.df69faa2-d199-4dcd-a8c0-621b7c133996" returned: 0 in 0.340s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-df69faa2-d199-4dcd-a8c0-621b7c133996" released by "_delete_snapshot" :: held 2.379s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:26 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-15950b55-596d-4f59-af76-49734841e657" returned: 0 in 0.355s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-ccefa255-0592-417b-a830-011a444f4e30" released by "delete_snapshot" :: held 2.422s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.200s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] Creating offline snapshot da1ba47c-4bcf-4082-a6bd-73243777b8ba of volume da30797c-4484-47e4-ab47-1d9f162e18a5 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a202ca8-eae2-4260-bf1e-fd9f357b51a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15950b55-596d-4f59-af76-49734841e657', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46f800e-f8d0-400d-a08a-1ca3dc1f9479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:26 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Volume volume-15950b55-596d-4f59-af76-49734841e657 (15950b55-596d-4f59-af76-49734841e657): created successfully Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46f800e-f8d0-400d-a08a-1ca3dc1f9479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Flow 'volume_create_manager' (1b66ec55-d2c7-429d-a1f3-632390853782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc25baf-6d81-4582-a476-89f506171abe]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:26 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-07a5c929-dff0-42c8-9e6b-a794ae821858 tempest-TestInstancesWithCinderVolumes-1974923323 None] Created volume successfully. Nov 06 10:48:26 devstack cinder-volume[86819]: WARNING cinder.quota [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2054089373 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2054089373, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] Created reservations ['2abd733f-f1d1-4518-ae4f-946af080c1e7', 'ccc7f251-7749-4d6e-b398-0f09d6456775', '8aaab308-b668-4685-81c8-51cc2b013d75', '0ffe4713-09ab-4daf-a37f-5c67572444a5'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:48:26 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5 Nov 06 10:48:26 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:26 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d9f46520-38ca-4d6f-b05e-b7e9a9ec38e6 tempest-GroupSnapshotsTest-28490446 None] group_snapshot a6bcec5b-2a91-4b44-abd9-2d693aad2693: deleted successfully Nov 06 10:48:26 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5" returned: 0 in 0.385s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:26 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba 1G Nov 06 10:48:26 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:27 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba 1G" returned: 0 in 0.472s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da30797c-4484-47e4-ab47-1d9f162e18a5 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:27 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da30797c-4484-47e4-ab47-1d9f162e18a5 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba Nov 06 10:48:27 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "cinder-quobyte-ccefa255-0592-417b-a830-011a444f4e30" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-ccefa255-0592-417b-a830-011a444f4e30" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:27 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da30797c-4484-47e4-ab47-1d9f162e18a5 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba" returned: 0 in 0.441s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:27 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba is being set with open permissions: ugo+rw Nov 06 10:48:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:27 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4479a03a-3582-41fc-b05d-d1d3a3d34f23]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:27 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba Nov 06 10:48:27 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:27 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 Nov 06 10:48:27 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:27 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba" returned: 0 in 0.284s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:27 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.info Nov 06 10:48:27 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:28 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30" returned: 0 in 0.667s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:28 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30 Nov 06 10:48:28 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:28 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.info" returned: 0 in 0.523s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:28 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.info is being set with open permissions: ugo+rw Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:28 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.info Nov 06 10:48:28 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:28 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ccefa255-0592-417b-a830-011a444f4e30" returned: 0 in 0.377s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-ccefa255-0592-417b-a830-011a444f4e30" released by "delete_volume" :: held 1.135s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Created reservations ['1c22e35c-c31c-4896-8c8b-f1ac5d16907e'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:48:28 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.info" returned: 0 in 0.354s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.636s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:28 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ac6b4012-10d1-40e7-96f5-d18460dd6117 tempest-VolumesSnapshotListTestJSON-1083707314 None] Create snapshot completed successfully Nov 06 10:48:28 devstack cinder-volume[86819]: WARNING cinder.db.api [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2054089373'] Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Created reservations ['8fcfd16a-8c13-43fd-bc28-adcefde0cdf6', '754c1f0e-8f80-477e-8938-30aff507dd27', '7abd6a28-b080-4e5c-92fe-3077eeaab0a8', 'bb5854be-d3f2-491e-8d3f-8ec08d955bb8'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:28 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:48:28 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:29 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.273s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:29 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:48:29 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a330e66a-d3cf-40d1-bcbd-7c955a2058e7 tempest-GroupSnapshotsTest-28490446 None] Delete group completed successfully. Nov 06 10:48:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ab513fcd-a3ee-44d3-8f7d-b3e07966a0b9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ab513fcd-a3ee-44d3-8f7d-b3e07966a0b9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-ab513fcd-a3ee-44d3-8f7d-b3e07966a0b9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Creating offline snapshot 193ba1df-4de9-4d94-aa91-cf107fc3e482 of volume da30797c-4484-47e4-ab47-1d9f162e18a5 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:48:29 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c853616-aa87-450a-8e82-7fd3d3431847]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab513fcd-a3ee-44d3-8f7d-b3e07966a0b9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:29 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba Nov 06 10:48:29 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:29 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab513fcd-a3ee-44d3-8f7d-b3e07966a0b9 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba" returned: 0 in 0.400s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-ab513fcd-a3ee-44d3-8f7d-b3e07966a0b9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da30797c-4484-47e4-ab47-1d9f162e18a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:48:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab513fcd-a3ee-44d3-8f7d-b3e07966a0b9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:29 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 1G Nov 06 10:48:29 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2a1239dc-0139-4256-8ac2-e120c3db467f tempest-GroupSnapshotsTest-28490446 None] Group tempest-GroupSnapshotsTest-Group-1979403181: creating Nov 06 10:48:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2a1239dc-0139-4256-8ac2-e120c3db467f tempest-GroupSnapshotsTest-28490446 None] Group tempest-GroupSnapshotsTest-Group-1979403181: created successfully Nov 06 10:48:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2a1239dc-0139-4256-8ac2-e120c3db467f tempest-GroupSnapshotsTest-28490446 None] Create group completed successfully. Nov 06 10:48:30 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab513fcd-a3ee-44d3-8f7d-b3e07966a0b9 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 1G" returned: 0 in 0.662s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab513fcd-a3ee-44d3-8f7d-b3e07966a0b9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:30 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 Nov 06 10:48:30 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:30 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab513fcd-a3ee-44d3-8f7d-b3e07966a0b9 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482" returned: 0 in 0.388s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:30 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-ab513fcd-a3ee-44d3-8f7d-b3e07966a0b9 tempest-VolumesSnapshotListTestJSON-1083707314 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 is being set with open permissions: ugo+rw Nov 06 10:48:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab513fcd-a3ee-44d3-8f7d-b3e07966a0b9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:30 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b19564eb-4671-4660-a545-87f7a8e65b4d_akgpwwb9devstack@QuobyteHD, size 20.69 MB, duration 4.93 sec {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 10:48:30 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Image download 20.69 MB at 4.20 MB/s Nov 06 10:48:30 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 Nov 06 10:48:30 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:31 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d8542d-aa61-4bea-bd9d-a166428ef0e0]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19564eb-4671-4660-a545-87f7a8e65b4d_akgpwwb9devstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:31 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19564eb-4671-4660-a545-87f7a8e65b4d_akgpwwb9devstack@QuobyteHD Nov 06 10:48:31 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:31 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ab513fcd-a3ee-44d3-8f7d-b3e07966a0b9 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482" returned: 0 in 0.350s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ab513fcd-a3ee-44d3-8f7d-b3e07966a0b9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:31 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ab513fcd-a3ee-44d3-8f7d-b3e07966a0b9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Create snapshot completed successfully Nov 06 10:48:31 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19564eb-4671-4660-a545-87f7a8e65b4d_akgpwwb9devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:31 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Temporary image b19564eb-4671-4660-a545-87f7a8e65b4d is fetched for user b7cf99f1ae8448ddbae10137b50a399b. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 10:48:31 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d872ff11-aec5-4b83-b506-505994207a3a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19564eb-4671-4660-a545-87f7a8e65b4d_akgpwwb9devstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:31 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19564eb-4671-4660-a545-87f7a8e65b4d_akgpwwb9devstack@QuobyteHD Nov 06 10:48:31 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9a856a1b-cd67-4004-81df-c61b463c505c tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9a856a1b-cd67-4004-81df-c61b463c505c tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9a856a1b-cd67-4004-81df-c61b463c505c tempest-VolumesSnapshotListTestJSON-1083707314 None] Creating offline snapshot aa53623a-afe0-4258-8774-69d894b1c5b7 of volume da30797c-4484-47e4-ab47-1d9f162e18a5 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:48:31 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef84b932-371a-4c5a-9e74-ae6969bb484a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9a856a1b-cd67-4004-81df-c61b463c505c tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:31 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 Nov 06 10:48:31 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:32 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19564eb-4671-4660-a545-87f7a8e65b4d_akgpwwb9devstack@QuobyteHD" returned: 0 in 0.467s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Flow 'volume_create_manager' (b1f3296e-f3aa-452d-a1e0-31eb2b9eb95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a144db80-e597-48b4-886b-09bcfd1fbe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a144db80-e597-48b4-886b-09bcfd1fbe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1501626538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=65c6a4cb-8877-4237-9c47-697591046177,host='devstack@QuobyteHD#QuobyteHD',id=f604f77e-f92f-4f1e-89c3-979ac9be7cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f67b2c63554cb19528268c54bd338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:48:32Z,use_quota=True,user_id='7c5387d14e8d4dafadb7405be37775d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a70734a-8d1b-41a1-a3b0-eb4a2ee0d01f),volume_type_id=9a70734a-8d1b-41a1-a3b0-eb4a2ee0d01f)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566dfb7f-0b1e-44ca-8c9b-1f47466e311c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566dfb7f-0b1e-44ca-8c9b-1f47466e311c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262e56a4-ca54-42bc-a161-da6e6822d779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262e56a4-ca54-42bc-a161-da6e6822d779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f604f77e-f92f-4f1e-89c3-979ac9be7cf3', 'volume_name': 'volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e3ced8f-4ee7-45e1-a0d4-b9fc75de47ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e3ced8f-4ee7-45e1-a0d4-b9fc75de47ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b69845e-dc86-4c65-953d-d54f04edf1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:32 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Volume f604f77e-f92f-4f1e-89c3-979ac9be7cf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3', 'volume_size': 1} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:32 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9a856a1b-cd67-4004-81df-c61b463c505c tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482" returned: 0 in 0.497s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9a856a1b-cd67-4004-81df-c61b463c505c tempest-VolumesSnapshotListTestJSON-1083707314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da30797c-4484-47e4-ab47-1d9f162e18a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9a856a1b-cd67-4004-81df-c61b463c505c tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:32 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7 1G Nov 06 10:48:32 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:32 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9a856a1b-cd67-4004-81df-c61b463c505c tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7 1G" returned: 0 in 0.500s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9a856a1b-cd67-4004-81df-c61b463c505c tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:32 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7 Nov 06 10:48:32 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:33 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9a856a1b-cd67-4004-81df-c61b463c505c tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7" returned: 0 in 0.320s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:33 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-9a856a1b-cd67-4004-81df-c61b463c505c tempest-VolumesSnapshotListTestJSON-1083707314 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7 is being set with open permissions: ugo+rw Nov 06 10:48:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9a856a1b-cd67-4004-81df-c61b463c505c tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:33 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7 Nov 06 10:48:33 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:33 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9a856a1b-cd67-4004-81df-c61b463c505c tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7" returned: 0 in 0.269s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9a856a1b-cd67-4004-81df-c61b463c505c tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.709s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.449s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1344420382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc528370-0c1d-42a7-beb7-9a80bbb576c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8572cbf5d4422a8b7b4f9352b3db51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:48:25Z,use_quota=True,user_id='b7cf99f1ae8448ddbae10137b50a399b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0cf2b23-ad41-491c-87d8-00983c4d651c),volume_type_id=a0cf2b23-ad41-491c-87d8-00983c4d651c)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:48:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Creating volume dc528370-0c1d-42a7-beb7-9a80bbb576c4 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:48:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:48:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:48:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:48:33 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:48:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:33 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 1073741824 Nov 06 10:48:33 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:33 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9a856a1b-cd67-4004-81df-c61b463c505c tempest-VolumesSnapshotListTestJSON-1083707314 None] Create snapshot completed successfully Nov 06 10:48:33 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 1073741824" returned: 0 in 0.497s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:34 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 Nov 06 10:48:34 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:34 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4" returned: 0 in 0.426s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.185s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=65c6a4cb-8877-4237-9c47-697591046177,created_at=2026-11-06T09:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1501626538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=65c6a4cb-8877-4237-9c47-697591046177,host='devstack@QuobyteHD#QuobyteHD',id=f604f77e-f92f-4f1e-89c3-979ac9be7cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f67b2c63554cb19528268c54bd338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:48:32Z,use_quota=True,user_id='7c5387d14e8d4dafadb7405be37775d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a70734a-8d1b-41a1-a3b0-eb4a2ee0d01f),volume_type_id=9a70734a-8d1b-41a1-a3b0-eb4a2ee0d01f)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Creating volume f604f77e-f92f-4f1e-89c3-979ac9be7cf3 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:48:34 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:34 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 1073741824 Nov 06 10:48:34 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Attempting download of b19564eb-4671-4660-a545-87f7a8e65b4d ((None, [{'url': 'file:///opt/stack/data/glance/images/b19564eb-4671-4660-a545-87f7a8e65b4d', 'metadata': {}}])) to volume dc528370-0c1d-42a7-beb7-9a80bbb576c4. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdf7d06-e48c-4cbe-8c82-95977460971b]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b19564eb-4671-4660-a545-87f7a8e65b4d_rix6dmqe {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:34 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b19564eb-4671-4660-a545-87f7a8e65b4d_rix6dmqe Nov 06 10:48:34 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "cinder-aa53623a-afe0-4258-8774-69d894b1c5b7-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-aa53623a-afe0-4258-8774-69d894b1c5b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "cinder-quobyte-da30797c-4484-47e4-ab47-1d9f162e18a5" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-quobyte-da30797c-4484-47e4-ab47-1d9f162e18a5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "cinder-quobyte-aa53623a-afe0-4258-8774-69d894b1c5b7" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:35 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-quobyte-aa53623a-afe0-4258-8774-69d894b1c5b7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Deleting offline snapshot aa53623a-afe0-4258-8774-69d894b1c5b7 of volume da30797c-4484-47e4-ab47-1d9f162e18a5 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] snapshot_file for this snap is: volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 1073741824" returned: 0 in 0.712s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76c84d8-3333-465c-9e13-c524d057606a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:35 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b19564eb-4671-4660-a545-87f7a8e65b4d_rix6dmqe" returned: 0 in 0.540s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b19564eb-4671-4660-a545-87f7a8e65b4d_rix6dmqe {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:35 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7 Nov 06 10:48:35 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:35 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 Nov 06 10:48:35 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:35 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b19564eb-4671-4660-a545-87f7a8e65b4d_rix6dmqe Nov 06 10:48:35 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:35 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3" returned: 0 in 0.307s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b69845e-dc86-4c65-953d-d54f04edf1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24804e2-afe3-470d-b164-01e560128c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:35 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:35 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Volume volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 (f604f77e-f92f-4f1e-89c3-979ac9be7cf3): created successfully Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24804e2-afe3-470d-b164-01e560128c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:35 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Flow 'volume_create_manager' (b1f3296e-f3aa-452d-a1e0-31eb2b9eb95a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b19564eb-4671-4660-a545-87f7a8e65b4d_rix6dmqe" returned: 1 in 0.449s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b19564eb-4671-4660-a545-87f7a8e65b4d_rix6dmqe' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7" returned: 0 in 0.483s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da30797c-4484-47e4-ab47-1d9f162e18a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4a21ad-d97b-48e1-846a-dd531af5987b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19564eb-4671-4660-a545-87f7a8e65b4d_akgpwwb9devstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7b2755-5f03-4c36-9350-e13716a13a76]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:35 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-85261cee-6d9a-4399-88ad-e3c4f2b8a41c tempest-GroupSnapshotsTest-28490446 None] Created volume successfully. Nov 06 10:48:35 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19564eb-4671-4660-a545-87f7a8e65b4d_akgpwwb9devstack@QuobyteHD Nov 06 10:48:35 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:35 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 Nov 06 10:48:35 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:36 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19564eb-4671-4660-a545-87f7a8e65b4d_akgpwwb9devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] b19564eb-4671-4660-a545-87f7a8e65b4d was qcow2, converting to qcow2 {{(pid=86819) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b19564eb-4671-4660-a545-87f7a8e65b4d_akgpwwb9devstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:36 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b19564eb-4671-4660-a545-87f7a8e65b4d_akgpwwb9devstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 Nov 06 10:48:36 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:36 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:48:36 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:36 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482" returned: 0 in 0.512s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da30797c-4484-47e4-ab47-1d9f162e18a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:36 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7 Nov 06 10:48:36 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:36 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.392s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 28 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:48:36 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7" returned: 0 in 0.538s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:36 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7 Nov 06 10:48:36 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:37 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.aa53623a-afe0-4258-8774-69d894b1c5b7" returned: 0 in 0.310s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-quobyte-aa53623a-afe0-4258-8774-69d894b1c5b7" released by "_delete_snapshot" :: held 2.012s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-quobyte-da30797c-4484-47e4-ab47-1d9f162e18a5" released by "delete_snapshot" :: held 2.047s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Created reservations ['fd8a23be-140a-4139-b442-2544b751207d', '3b5f6a0a-4d2e-4c16-9cbe-fb3a40ed47ab', '60e8b051-ded9-45a2-9e33-27c3de7e199f', 'f6c7152c-b6d6-4dc2-a7c3-0412aad654c6'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:48:37 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Delete snapshot completed successfully. Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-38dba134-656a-42cc-91bc-da56662f1987 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-aa53623a-afe0-4258-8774-69d894b1c5b7-delete_snapshot" released by "delete_snapshot" :: held 2.286s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Flow 'volume_create_manager' (aa0f174d-5004-4ff7-9bb0-1adc6191f4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f20a86-0dd4-4259-bbf5-2160c35155c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f20a86-0dd4-4259-bbf5-2160c35155c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1537422287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=65c6a4cb-8877-4237-9c47-697591046177,host='devstack@QuobyteHD#QuobyteHD',id=5263a6b5-c6d8-4709-9126-a8a54238b96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f67b2c63554cb19528268c54bd338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:48:38Z,use_quota=True,user_id='7c5387d14e8d4dafadb7405be37775d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a70734a-8d1b-41a1-a3b0-eb4a2ee0d01f),volume_type_id=9a70734a-8d1b-41a1-a3b0-eb4a2ee0d01f)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaac5d67-88c4-4fd1-b08e-7164f611f5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaac5d67-88c4-4fd1-b08e-7164f611f5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ddbb31-1ee5-47cc-9be9-bd5bd61680f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ddbb31-1ee5-47cc-9be9-bd5bd61680f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5263a6b5-c6d8-4709-9126-a8a54238b96f', 'volume_name': 'volume-5263a6b5-c6d8-4709-9126-a8a54238b96f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385d89b5-68f9-4468-8546-24743b58cb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385d89b5-68f9-4468-8546-24743b58cb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ca025a-f0be-4c8f-9a8e-2e93799576ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:37 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Volume 5263a6b5-c6d8-4709-9126-a8a54238b96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5263a6b5-c6d8-4709-9126-a8a54238b96f', 'volume_size': 1} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=65c6a4cb-8877-4237-9c47-697591046177,created_at=2026-11-06T09:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1537422287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=65c6a4cb-8877-4237-9c47-697591046177,host='devstack@QuobyteHD#QuobyteHD',id=5263a6b5-c6d8-4709-9126-a8a54238b96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f67b2c63554cb19528268c54bd338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:48:38Z,use_quota=True,user_id='7c5387d14e8d4dafadb7405be37775d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a70734a-8d1b-41a1-a3b0-eb4a2ee0d01f),volume_type_id=9a70734a-8d1b-41a1-a3b0-eb4a2ee0d01f)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Creating volume 5263a6b5-c6d8-4709-9126-a8a54238b96f {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:48:37 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:48:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:37 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f 1073741824 Nov 06 10:48:37 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "cinder-193ba1df-4de9-4d94-aa91-cf107fc3e482-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-193ba1df-4de9-4d94-aa91-cf107fc3e482-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "cinder-quobyte-da30797c-4484-47e4-ab47-1d9f162e18a5" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-quobyte-da30797c-4484-47e4-ab47-1d9f162e18a5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "cinder-quobyte-193ba1df-4de9-4d94-aa91-cf107fc3e482" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:38 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-quobyte-193ba1df-4de9-4d94-aa91-cf107fc3e482" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Deleting offline snapshot 193ba1df-4de9-4d94-aa91-cf107fc3e482 of volume da30797c-4484-47e4-ab47-1d9f162e18a5 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:48:38 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] snapshot_file for this snap is: volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f 1073741824" returned: 0 in 0.610s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b19564eb-4671-4660-a545-87f7a8e65b4d_akgpwwb9devstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4" returned: 0 in 2.388s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b19564eb-4671-4660-a545-87f7a8e65b4d_akgpwwb9devstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:48:38 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Converted 112.00 MB image at 46.85 MB/s Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bcfd3a-951f-4f29-8963-0af0ff522e58]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:38 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 1G Nov 06 10:48:38 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:38 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f Nov 06 10:48:38 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:38 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 Nov 06 10:48:38 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:38 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f" returned: 0 in 0.318s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ca025a-f0be-4c8f-9a8e-2e93799576ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5263a6b5-c6d8-4709-9126-a8a54238b96f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aba6719-ade4-4cf2-b8da-249b04c70ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:38 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Volume volume-5263a6b5-c6d8-4709-9126-a8a54238b96f (5263a6b5-c6d8-4709-9126-a8a54238b96f): created successfully Nov 06 10:48:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aba6719-ade4-4cf2-b8da-249b04c70ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:39 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Flow 'volume_create_manager' (aa0f174d-5004-4ff7-9bb0-1adc6191f4ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 1G" returned: 0 in 0.515s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Downloaded image b19564eb-4671-4660-a545-87f7a8e65b4d ((None, [{'url': 'file:///opt/stack/data/glance/images/b19564eb-4671-4660-a545-87f7a8e65b4d', 'metadata': {}}])) to volume dc528370-0c1d-42a7-beb7-9a80bbb576c4 successfully. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 10:48:39 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Temporary image b19564eb-4671-4660-a545-87f7a8e65b4d for user b7cf99f1ae8448ddbae10137b50a399b is deleted. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Marking volume dc528370-0c1d-42a7-beb7-9a80bbb576c4 as bootable. {{(pid=86819) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482" returned: 0 in 0.505s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da30797c-4484-47e4-ab47-1d9f162e18a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:48:39 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-beff67fe-a336-44f3-b5ad-6cbd7c0fab2a tempest-GroupSnapshotsTest-28490446 None] Created volume successfully. Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Copying metadata from image b19564eb-4671-4660-a545-87f7a8e65b4d to dc528370-0c1d-42a7-beb7-9a80bbb576c4. {{(pid=86819) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Creating volume glance metadata for volume dc528370-0c1d-42a7-beb7-9a80bbb576c4 backed by image b19564eb-4671-4660-a545-87f7a8e65b4d with: {'image_id': 'b19564eb-4671-4660-a545-87f7a8e65b4d', 'image_name': 'tempest-scenario-img--1783217607', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86819) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b04ffdb-3572-405a-bb72-3fca5ad031ea]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd97ae7-b283-4bda-bb74-4b8d24b21486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4', 'volume_size': 1, 'image_id': 'b19564eb-4671-4660-a545-87f7a8e65b4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b19564eb-4671-4660-a545-87f7a8e65b4d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1783217607', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ef8572cbf5d4422a8b7b4f9352b3db51', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b19564eb-4671-4660-a545-87f7a8e65b4d', 'created_at': datetime.datetime(2026, 11, 6, 9, 48, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 48, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b19564eb-4671-4660-a545-87f7a8e65b4d/file', 'properties': {}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d66c0f-4093-4006-b604-34a664997d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:48:39 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Volume volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 (dc528370-0c1d-42a7-beb7-9a80bbb576c4): created successfully Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d66c0f-4093-4006-b604-34a664997d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Flow 'volume_create_manager' (920b2ba9-4609-4674-978e-35fe10d4ef79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:48:39 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba Nov 06 10:48:39 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:39 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ef42cb13-1042-420e-bf32-1f87c208efbe tempest-TestInstancesWithCinderVolumes-1974923323 None] Created volume successfully. Nov 06 10:48:39 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba" returned: 0 in 0.381s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da30797c-4484-47e4-ab47-1d9f162e18a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:39 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 Nov 06 10:48:39 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:39 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482" returned: 0 in 0.401s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:39 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482 Nov 06 10:48:39 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:40 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.193ba1df-4de9-4d94-aa91-cf107fc3e482" returned: 0 in 0.279s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-quobyte-193ba1df-4de9-4d94-aa91-cf107fc3e482" released by "_delete_snapshot" :: held 1.709s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-quobyte-da30797c-4484-47e4-ab47-1d9f162e18a5" released by "delete_snapshot" :: held 1.742s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:40 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Created reservations ['def603a6-38ca-4a74-a5b4-6b623d8a2d25', 'c272ad82-52fc-4e1f-9569-ceddafe92ce5', 'f7963b7f-3eb2-46ba-8243-9b047176836c', 'de352c66-5c7b-4151-9abe-79f2cd383406'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:48:40 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Delete snapshot completed successfully. Nov 06 10:48:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9b6089fa-f314-426d-b865-37775bd1063f tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-193ba1df-4de9-4d94-aa91-cf107fc3e482-delete_snapshot" released by "delete_snapshot" :: held 1.962s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:40 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9497b10a-1bc4-4ceb-a92c-80b22bb53eb8 tempest-GroupSnapshotsTest-28490446 None] Update group completed successfully. Nov 06 10:48:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "cinder-da1ba47c-4bcf-4082-a6bd-73243777b8ba-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-da1ba47c-4bcf-4082-a6bd-73243777b8ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "cinder-quobyte-da30797c-4484-47e4-ab47-1d9f162e18a5" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-quobyte-da30797c-4484-47e4-ab47-1d9f162e18a5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "cinder-quobyte-da1ba47c-4bcf-4082-a6bd-73243777b8ba" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-quobyte-da1ba47c-4bcf-4082-a6bd-73243777b8ba" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Deleting offline snapshot da1ba47c-4bcf-4082-a6bd-73243777b8ba of volume da30797c-4484-47e4-ab47-1d9f162e18a5 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:48:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] snapshot_file for this snap is: volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:48:40 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b64f334-173c-4a75-942b-e9e59d33ddd3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:40 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba Nov 06 10:48:40 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:41 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba" returned: 0 in 0.457s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da30797c-4484-47e4-ab47-1d9f162e18a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:48:41 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0bb650-bcf1-4883-8d70-05a71d97351c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:41 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5 Nov 06 10:48:41 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:41 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-1d1de193-045f-4ad8-852f-ab85d43d6784 tempest-GroupSnapshotsTest-28490446 None] Update group completed successfully. Nov 06 10:48:41 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5" returned: 0 in 0.698s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:41 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba Nov 06 10:48:41 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:42 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba" returned: 0 in 0.471s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:42 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba Nov 06 10:48:42 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:42 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5.da1ba47c-4bcf-4082-a6bd-73243777b8ba" returned: 0 in 0.319s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-quobyte-da1ba47c-4bcf-4082-a6bd-73243777b8ba" released by "_delete_snapshot" :: held 2.172s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-quobyte-da30797c-4484-47e4-ab47-1d9f162e18a5" released by "delete_snapshot" :: held 2.202s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:42 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Created reservations ['e8455d18-d7a6-4d4b-99f5-304b2ffe46ac', '114bd940-1da7-46b0-9853-4d58322e4b4c', '9c371690-a3ab-4d8e-9099-9713dd111df5', '0f8f2c72-8192-4efa-bbfe-1f8b9ed355a2'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:48:43 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Delete snapshot completed successfully. Nov 06 10:48:43 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4f742025-b790-411e-9b62-6b704fbcd2e9 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-da1ba47c-4bcf-4082-a6bd-73243777b8ba-delete_snapshot" released by "delete_snapshot" :: held 2.488s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:43 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-6989511c-5ca7-4ae8-bc92-c03d1cfa4bb9 tempest-GroupSnapshotsTest-28490446 None] Update group completed successfully. Nov 06 10:48:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-44c05904-9948-47e7-aab5-93d683ee5566 req-b9f085ea-1423-4a5d-b2ae-72260cd8f437 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-44c05904-9948-47e7-aab5-93d683ee5566 req-b9f085ea-1423-4a5d-b2ae-72260cd8f437 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-44c05904-9948-47e7-aab5-93d683ee5566 req-b9f085ea-1423-4a5d-b2ae-72260cd8f437 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-44c05904-9948-47e7-aab5-93d683ee5566 req-b9f085ea-1423-4a5d-b2ae-72260cd8f437 tempest-TestInstancesWithCinderVolumes-1974923323 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b520f097-8a2c-4e4d-99d3-4127b5ad6c71', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:48:43 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-44c05904-9948-47e7-aab5-93d683ee5566 req-b9f085ea-1423-4a5d-b2ae-72260cd8f437 tempest-TestInstancesWithCinderVolumes-1974923323 None] attachment_update completed successfully. Nov 06 10:48:43 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "cinder-da30797c-4484-47e4-ab47-1d9f162e18a5-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:43 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-da30797c-4484-47e4-ab47-1d9f162e18a5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "cinder-quobyte-da30797c-4484-47e4-ab47-1d9f162e18a5" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-quobyte-da30797c-4484-47e4-ab47-1d9f162e18a5" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:44 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8332d65d-16c0-45a3-b1d8-b8fe3ccd6c19]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:44 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5 Nov 06 10:48:44 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:44 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-fae3477f-9328-4d61-b458-735f4b9e41c3 tempest-GroupSnapshotsTest-28490446 None] Update group completed successfully. Nov 06 10:48:44 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5" returned: 0 in 0.524s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:44 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5 Nov 06 10:48:44 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:45 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da30797c-4484-47e4-ab47-1d9f162e18a5" returned: 0 in 0.294s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-quobyte-da30797c-4484-47e4-ab47-1d9f162e18a5" released by "delete_volume" :: held 0.962s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:45 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Created reservations ['98787a02-a207-4a0e-8278-7fd38d06c41f', '75819bb4-594b-4778-b274-97435cd99cff', '84a7ba38-4945-48c4-ad3c-7a34810ac4d1', 'a847abe0-a23d-4099-96b9-34eca05beb61'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:48:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:48:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:48:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:45 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:48:45 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:45 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.318s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:45 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:48:45 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Deleted volume successfully. Nov 06 10:48:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7f304bfc-591d-465a-9dac-a464c905c381 tempest-VolumesSnapshotListTestJSON-1083707314 None] Lock "cinder-da30797c-4484-47e4-ab47-1d9f162e18a5-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:46 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] GroupSnapshot 20aeb494-e9b0-4bb0-8c8d-70e67718e5c3: creating. Nov 06 10:48:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Group snapshot 20aeb494-e9b0-4bb0-8c8d-70e67718e5c3: creating. {{(pid=86819) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 10:48:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Creating offline snapshot 7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 of volume 5263a6b5-c6d8-4709-9126-a8a54238b96f {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:48:46 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acfdaf3-90a9-4f04-bb42-114fafc8ee90]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:46 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f Nov 06 10:48:46 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:46 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f" returned: 0 in 0.669s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:46 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 1G Nov 06 10:48:46 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:47 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 1G" returned: 0 in 0.641s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5263a6b5-c6d8-4709-9126-a8a54238b96f -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:47 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5263a6b5-c6d8-4709-9126-a8a54238b96f -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 Nov 06 10:48:47 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:47 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5263a6b5-c6d8-4709-9126-a8a54238b96f -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9" returned: 0 in 0.374s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:47 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 10:48:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:47 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 Nov 06 10:48:47 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:48 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9" returned: 0 in 0.338s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:48 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.info Nov 06 10:48:48 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:48 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.info" returned: 0 in 0.402s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:48 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 10:48:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:48 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.info Nov 06 10:48:48 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:49 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.info" returned: 0 in 0.509s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.090s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:48:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:48:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Creating offline snapshot 8d11e585-d9de-442e-8ff6-90b6f35bf949 of volume f604f77e-f92f-4f1e-89c3-979ac9be7cf3 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:48:49 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fe0ed9-a243-442d-b03b-2b8279096ffe]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:49 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 Nov 06 10:48:49 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:50 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3" returned: 0 in 0.994s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:50 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949 1G Nov 06 10:48:50 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:50 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949 1G" returned: 0 in 0.635s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:51 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949 Nov 06 10:48:51 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:51 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949" returned: 0 in 0.732s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:51 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 10:48:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:51 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949 Nov 06 10:48:51 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:52 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949" returned: 0 in 0.501s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:52 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.info Nov 06 10:48:52 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:52 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.info" returned: 0 in 0.384s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:52 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 10:48:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:52 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.info Nov 06 10:48:52 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:53 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.info" returned: 0 in 0.411s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.838s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:48:53 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d237034a-ebbe-4568-a2ff-3ce6eef9dac4 tempest-GroupSnapshotsTest-28490446 None] group_snapshot 20aeb494-e9b0-4bb0-8c8d-70e67718e5c3: created successfully Nov 06 10:48:54 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] group_snapshot 20aeb494-e9b0-4bb0-8c8d-70e67718e5c3: deleting Nov 06 10:48:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] group_snapshot 20aeb494-e9b0-4bb0-8c8d-70e67718e5c3: deleting {{(pid=86819) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 10:48:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "cinder-quobyte-5263a6b5-c6d8-4709-9126-a8a54238b96f" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-5263a6b5-c6d8-4709-9126-a8a54238b96f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "cinder-quobyte-7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Deleting offline snapshot 7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 of volume 5263a6b5-c6d8-4709-9126-a8a54238b96f {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:48:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] snapshot_file for this snap is: volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:48:54 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[46de1600-e430-4e36-a5f9-4769416bba47]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:54 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 Nov 06 10:48:54 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:55 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9" returned: 0 in 0.702s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5263a6b5-c6d8-4709-9126-a8a54238b96f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:48:55 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a5b11a-53dc-49fe-8625-9a1acd696919]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:55 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f Nov 06 10:48:55 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:55 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f" returned: 0 in 0.585s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:55 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 Nov 06 10:48:55 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:56 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9" returned: 0 in 0.577s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:56 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9 Nov 06 10:48:56 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:56 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f.7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9" returned: 0 in 0.405s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-7746cc68-7b8f-4f05-a4bb-120c1ffc9ae9" released by "_delete_snapshot" :: held 2.524s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-5263a6b5-c6d8-4709-9126-a8a54238b96f" released by "delete_snapshot" :: held 2.555s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "cinder-quobyte-f604f77e-f92f-4f1e-89c3-979ac9be7cf3" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-f604f77e-f92f-4f1e-89c3-979ac9be7cf3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "cinder-quobyte-8d11e585-d9de-442e-8ff6-90b6f35bf949" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:48:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-8d11e585-d9de-442e-8ff6-90b6f35bf949" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:48:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Deleting offline snapshot 8d11e585-d9de-442e-8ff6-90b6f35bf949 of volume f604f77e-f92f-4f1e-89c3-979ac9be7cf3 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:48:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] snapshot_file for this snap is: volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:48:57 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad514997-b49a-4ee9-8557-932bf433b43b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:57 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949 Nov 06 10:48:57 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:57 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949" returned: 0 in 0.518s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:48:57 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3c652a-2d78-4348-893f-0d84f7b13665]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:48:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:57 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 Nov 06 10:48:57 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:58 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3" returned: 0 in 0.514s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:58 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949 Nov 06 10:48:58 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:58 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949" returned: 0 in 0.399s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:48:58 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949 Nov 06 10:48:58 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:48:58 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Nov 06 10:48:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3.8d11e585-d9de-442e-8ff6-90b6f35bf949" returned: 0 in 0.263s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:48:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-8d11e585-d9de-442e-8ff6-90b6f35bf949" released by "_delete_snapshot" :: held 1.912s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-f604f77e-f92f-4f1e-89c3-979ac9be7cf3" released by "delete_snapshot" :: held 1.952s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:48:59 devstack cinder-volume[86819]: WARNING cinder.quota [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1002523669 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1002523669, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:48:59 devstack cinder-volume[86819]: WARNING cinder.quota [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1002523669 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1002523669, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:48:59 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Created reservations ['ef7c67e5-c671-4838-af3d-aa690602b44d', '884690d9-80a8-4e2e-94e0-b613a88e84c1', 'ade04264-ac13-49d8-af60-bd3320a759b3', '0333fdfc-59cc-4a43-9f86-763582f13986'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:48:59 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] Created reservations ['22c23d1c-a560-4807-bc0b-4924d3bb2a8e', '7148031a-337f-4194-b8a0-2f4625d7626b', '20e69370-6783-454b-b902-6267c30e2df8', '21279a15-e567-40e8-b56c-03602e3f3f4a'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:48:59 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c522f282-e367-4c23-b269-baf8ad9ab308 tempest-GroupSnapshotsTest-28490446 None] group_snapshot 20aeb494-e9b0-4bb0-8c8d-70e67718e5c3: deleted successfully Nov 06 10:49:01 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=124,cinder:UPDATE=112,cinder:INSERT=24,cinder:DELETE=8 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:49:01 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=116,cinder:SELECT=127,cinder:INSERT=39,cinder:DELETE=4 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:49:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "cinder-quobyte-5263a6b5-c6d8-4709-9126-a8a54238b96f" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-5263a6b5-c6d8-4709-9126-a8a54238b96f" acquired by "delete_volume" :: waited 0.056s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:01 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c9f180-cd15-4b1d-8176-2396ef28e049]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:49:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:01 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f Nov 06 10:49:01 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:01 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f" returned: 0 in 0.475s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:01 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f Nov 06 10:49:01 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:02 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5263a6b5-c6d8-4709-9126-a8a54238b96f" returned: 0 in 0.383s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-5263a6b5-c6d8-4709-9126-a8a54238b96f" released by "delete_volume" :: held 0.956s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "cinder-quobyte-f604f77e-f92f-4f1e-89c3-979ac9be7cf3" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-f604f77e-f92f-4f1e-89c3-979ac9be7cf3" acquired by "delete_volume" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:02 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e484b838-2a0c-4b9f-aa0b-c600516e7654]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:49:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:02 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 Nov 06 10:49:02 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:02 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3" returned: 0 in 0.575s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:02 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3 Nov 06 10:49:02 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:03 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f604f77e-f92f-4f1e-89c3-979ac9be7cf3" returned: 0 in 0.674s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-f604f77e-f92f-4f1e-89c3-979ac9be7cf3" released by "delete_volume" :: held 1.370s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:03 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Created reservations ['758fc39e-3b57-43ee-b3e7-2bd8ae55ce4a'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:03 devstack cinder-volume[86819]: WARNING cinder.quota [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1002523669 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1002523669, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:49:03 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Created reservations ['21580b4e-53fe-445d-a73a-4a06e86541a4', '09b2a1b2-f0c0-487c-869f-3fe5a53b0338', '607a6b13-ea5a-4c55-9613-8c22886dafe8', '517e1e0b-5ee0-4156-9429-70b30e5d9962'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:04 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Created reservations ['c8c78441-f84a-4930-b05f-c3325cceb975', '04b9ee89-0ba8-4e66-8b74-7db995c2214c', '5fcdec14-37f5-4a6d-b0d9-7b7003d164b4', '240042ec-411e-4285-a3ce-301ee8d590d8'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:04 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:49:04 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.485s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:04 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:49:04 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:04 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-0343469f-23de-4389-bb4a-c6b497c8462a tempest-GroupSnapshotsTest-28490446 None] Delete group completed successfully. Nov 06 10:49:06 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a15a7dd7-4975-404e-8934-8d565fb596cd tempest-GroupSnapshotsTest-28490446 None] Group tempest-GroupSnapshotsTest-Group-1625583828: creating Nov 06 10:49:06 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a15a7dd7-4975-404e-8934-8d565fb596cd tempest-GroupSnapshotsTest-28490446 None] Group tempest-GroupSnapshotsTest-Group-1625583828: created successfully Nov 06 10:49:06 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a15a7dd7-4975-404e-8934-8d565fb596cd tempest-GroupSnapshotsTest-28490446 None] Create group completed successfully. Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Flow 'volume_create_manager' (7c563bb0-2762-4ec9-ac0e-ed5434cb3406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a0dbee-7dbf-484f-8b7f-efe7f2863140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a0dbee-7dbf-484f-8b7f-efe7f2863140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-820186760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07d57f32-edfb-472b-a454-09ae6cdab349,host='devstack@QuobyteHD#QuobyteHD',id=f799679e-aed0-4960-aeb2-2450f051c687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f67b2c63554cb19528268c54bd338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:08Z,use_quota=True,user_id='7c5387d14e8d4dafadb7405be37775d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2113c77e-1ecf-40ff-a317-4fd0c18ad0c2),volume_type_id=2113c77e-1ecf-40ff-a317-4fd0c18ad0c2)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6cd10a9-af1e-4027-a482-806499c73d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6cd10a9-af1e-4027-a482-806499c73d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e0bd7d-f925-4ef7-98e7-b70f9e3f9ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e0bd7d-f925-4ef7-98e7-b70f9e3f9ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f799679e-aed0-4960-aeb2-2450f051c687', 'volume_name': 'volume-f799679e-aed0-4960-aeb2-2450f051c687', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab7b46e-1096-489d-88d5-bc1ea55054e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab7b46e-1096-489d-88d5-bc1ea55054e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4455407c-e2e7-480d-bbd4-cbb92f4f67be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:08 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Volume f799679e-aed0-4960-aeb2-2450f051c687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f799679e-aed0-4960-aeb2-2450f051c687', 'volume_size': 1} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=07d57f32-edfb-472b-a454-09ae6cdab349,created_at=2026-11-06T09:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-820186760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07d57f32-edfb-472b-a454-09ae6cdab349,host='devstack@QuobyteHD#QuobyteHD',id=f799679e-aed0-4960-aeb2-2450f051c687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f67b2c63554cb19528268c54bd338c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:08Z,use_quota=True,user_id='7c5387d14e8d4dafadb7405be37775d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2113c77e-1ecf-40ff-a317-4fd0c18ad0c2),volume_type_id=2113c77e-1ecf-40ff-a317-4fd0c18ad0c2)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Creating volume f799679e-aed0-4960-aeb2-2450f051c687 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:49:08 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:49:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:08 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687 1073741824 Nov 06 10:49:08 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:09 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687 1073741824" returned: 0 in 0.901s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:09 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687 Nov 06 10:49:09 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:10 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687" returned: 0 in 0.808s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:10 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:49:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4455407c-e2e7-480d-bbd4-cbb92f4f67be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f799679e-aed0-4960-aeb2-2450f051c687', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6870a8-6f57-4dda-a0c2-82ec73016a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:10 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Volume volume-f799679e-aed0-4960-aeb2-2450f051c687 (f799679e-aed0-4960-aeb2-2450f051c687): created successfully Nov 06 10:49:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6870a8-6f57-4dda-a0c2-82ec73016a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Flow 'volume_create_manager' (7c563bb0-2762-4ec9-ac0e-ed5434cb3406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:10 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2cdb4532-adcc-4eac-bd33-74fab7368cd9 tempest-GroupSnapshotsTest-28490446 None] Created volume successfully. Nov 06 10:49:10 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:49:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Flow 'volume_create_manager' (7feff87c-1b83-4b37-9438-352c584a05d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5979855f-9330-467d-88b2-ef5f531485d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5979855f-9330-467d-88b2-ef5f531485d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-160215675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5afee785d0343f9b79507193bd5e46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:11Z,use_quota=True,user_id='aee697a63b8a450bbe8902dfa4761f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e526cd-d0f7-4d11-9136-4419f6d32e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e526cd-d0f7-4d11-9136-4419f6d32e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c09dab-e56e-42b7-93e1-0f3e99dc999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c09dab-e56e-42b7-93e1-0f3e99dc999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6', 'volume_name': 'volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f59250-8bed-4632-a716-f0abc49aab28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f59250-8bed-4632-a716-f0abc49aab28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076d4569-ef59-4a64-8026-cc2a11eaf564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:11 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Volume b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6', 'volume_size': 1} Nov 06 10:49:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-160215675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5afee785d0343f9b79507193bd5e46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:11Z,use_quota=True,user_id='aee697a63b8a450bbe8902dfa4761f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:49:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Creating volume b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:49:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:49:11 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:49:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:11 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6 1073741824 Nov 06 10:49:11 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:12 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6 1073741824" returned: 0 in 1.100s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:12 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6 Nov 06 10:49:12 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:12 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] GroupSnapshot c6b1531c-8efe-4ec5-8956-1a905dfc3c8b: creating. Nov 06 10:49:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] Group snapshot c6b1531c-8efe-4ec5-8956-1a905dfc3c8b: creating. {{(pid=86819) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 10:49:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:12 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6" returned: 0 in 0.511s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:49:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.328s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076d4569-ef59-4a64-8026-cc2a11eaf564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a18086-5bc3-49ac-814e-93819e8981c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] Creating offline snapshot ff28447d-385d-4002-9c1f-015eecc25130 of volume f799679e-aed0-4960-aeb2-2450f051c687 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:49:12 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Volume volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6 (b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6): created successfully Nov 06 10:49:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a18086-5bc3-49ac-814e-93819e8981c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Flow 'volume_create_manager' (7feff87c-1b83-4b37-9438-352c584a05d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:12 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-87e06c4b-292e-40a9-8914-ac5d158fa153 tempest-VolumesActionsTest-1019662994 None] Created volume successfully. Nov 06 10:49:13 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab0afff-27d3-4d20-8b9c-f5fa88aa1e20]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:49:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:13 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687 Nov 06 10:49:13 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:13 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687" returned: 0 in 0.756s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:13 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130 1G Nov 06 10:49:13 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-94b332b2-4aec-4527-94f4-2202c36b395c tempest-VolumesActionsTest-1019662994 None] Acquiring lock "cinder-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6" by "attach_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-94b332b2-4aec-4527-94f4-2202c36b395c tempest-VolumesActionsTest-1019662994 None] Lock "cinder-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6" acquired by "attach_volume" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:14 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-94b332b2-4aec-4527-94f4-2202c36b395c tempest-VolumesActionsTest-1019662994 None] Attaching volume b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6 to instance 6de0e246-86bc-4397-8831-4d2695e13241 at mountpoint /dev/vdb on host None. Nov 06 10:49:14 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-94b332b2-4aec-4527-94f4-2202c36b395c tempest-VolumesActionsTest-1019662994 None] Attach volume completed successfully. Nov 06 10:49:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-94b332b2-4aec-4527-94f4-2202c36b395c tempest-VolumesActionsTest-1019662994 None] Lock "cinder-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6" released by "attach_volume" :: held 0.135s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:14 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130 1G" returned: 0 in 0.651s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f799679e-aed0-4960-aeb2-2450f051c687 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:14 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f799679e-aed0-4960-aeb2-2450f051c687 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130 Nov 06 10:49:14 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:14 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f799679e-aed0-4960-aeb2-2450f051c687 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130" returned: 0 in 0.446s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:14 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 10:49:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:14 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130 Nov 06 10:49:14 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:15 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130" returned: 0 in 0.325s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:15 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.info Nov 06 10:49:15 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:15 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.info" returned: 0 in 0.327s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:15 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 10:49:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:15 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.info Nov 06 10:49:15 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:15 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-140c3a3c-9ca2-4937-bd59-367abda5cfe8 tempest-VolumesActionsTest-368697794 None] Terminate volume connection completed successfully. Nov 06 10:49:15 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-140c3a3c-9ca2-4937-bd59-367abda5cfe8 tempest-VolumesActionsTest-368697794 None] Acquiring lock "cinder-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6-detach_volume" by "detach_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:15 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-140c3a3c-9ca2-4937-bd59-367abda5cfe8 tempest-VolumesActionsTest-368697794 None] Lock "cinder-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:15 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-140c3a3c-9ca2-4937-bd59-367abda5cfe8 tempest-VolumesActionsTest-368697794 None] Detaching volume b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6 from instance 6de0e246-86bc-4397-8831-4d2695e13241. Nov 06 10:49:15 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-140c3a3c-9ca2-4937-bd59-367abda5cfe8 tempest-VolumesActionsTest-368697794 None] Detach volume completed successfully. Nov 06 10:49:15 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-140c3a3c-9ca2-4937-bd59-367abda5cfe8 tempest-VolumesActionsTest-368697794 None] Lock "cinder-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6-detach_volume" released by "detach_volume" :: held 0.113s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:15 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.info" returned: 0 in 0.363s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.132s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:16 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2d2df253-9524-4111-8358-e20fd69cebfe tempest-GroupSnapshotsTest-28490446 None] group_snapshot c6b1531c-8efe-4ec5-8956-1a905dfc3c8b: created successfully Nov 06 10:49:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-82b2f0a9-913d-466a-b3b6-405f56d5b3f9 tempest-VolumesActionsTest-1019662994 None] Acquiring lock "cinder-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6-detach_volume" by "detach_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-82b2f0a9-913d-466a-b3b6-405f56d5b3f9 tempest-VolumesActionsTest-1019662994 None] Lock "cinder-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:16 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-82b2f0a9-913d-466a-b3b6-405f56d5b3f9 tempest-VolumesActionsTest-1019662994 None] Volume detach called, but volume not attached. Nov 06 10:49:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-82b2f0a9-913d-466a-b3b6-405f56d5b3f9 tempest-VolumesActionsTest-1019662994 None] Lock "cinder-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Acquiring lock "cinder-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Lock "cinder-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Acquiring lock "cinder-quobyte-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Lock "cinder-quobyte-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:16 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[361ad2f8-4c55-454e-a90e-304fb5ce2d53]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:49:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:16 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6 Nov 06 10:49:16 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:17 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6" returned: 0 in 0.452s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:17 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] group_snapshot c6b1531c-8efe-4ec5-8956-1a905dfc3c8b: deleting Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] group_snapshot c6b1531c-8efe-4ec5-8956-1a905dfc3c8b: deleting {{(pid=86819) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 10:49:17 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6 Nov 06 10:49:17 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "cinder-quobyte-f799679e-aed0-4960-aeb2-2450f051c687" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-f799679e-aed0-4960-aeb2-2450f051c687" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "cinder-quobyte-ff28447d-385d-4002-9c1f-015eecc25130" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-ff28447d-385d-4002-9c1f-015eecc25130" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] Deleting offline snapshot ff28447d-385d-4002-9c1f-015eecc25130 of volume f799679e-aed0-4960-aeb2-2450f051c687 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] snapshot_file for this snap is: volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c412ad59-c54c-4ffc-bcab-80350ee99063]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:17 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130 Nov 06 10:49:17 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:17 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6" returned: 0 in 0.447s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Lock "cinder-quobyte-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6" released by "delete_volume" :: held 0.970s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Created reservations ['8ef73bfc-4912-4d37-ab74-d8c9db41a6ba', '9071ebd0-bdb7-4527-9cbc-1915736fb448', '584cbead-c6a9-4825-ba61-9a69e4ca04aa', '7b3e2413-8101-46ed-88b2-260bb831a3d6'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:17 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:49:17 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:17 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130" returned: 0 in 0.632s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f799679e-aed0-4960-aeb2-2450f051c687(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:49:18 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc5a2a1-08cb-4b76-84ab-c5b5d3abd524]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:49:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:18 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687 Nov 06 10:49:18 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:18 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.405s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:18 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:49:18 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Deleted volume successfully. Nov 06 10:49:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b24a17c8-e925-47d1-8942-8ed39d072e23 tempest-VolumesActionsTest-1019662994 None] Lock "cinder-b6b0cf68-f746-4585-bd5c-e5d9b4ef9ce6-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:18 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687" returned: 0 in 0.605s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:18 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130 Nov 06 10:49:18 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:19 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130" returned: 0 in 0.666s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:19 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130 Nov 06 10:49:19 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:19 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687.ff28447d-385d-4002-9c1f-015eecc25130" returned: 0 in 0.425s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-ff28447d-385d-4002-9c1f-015eecc25130" released by "_delete_snapshot" :: held 2.619s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-f799679e-aed0-4960-aeb2-2450f051c687" released by "delete_snapshot" :: held 2.654s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:20 devstack cinder-volume[86819]: WARNING cinder.quota [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-118960257 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-118960257, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:49:20 devstack cinder-volume[86819]: WARNING cinder.quota [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-118960257 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-118960257, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:49:20 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] Created reservations ['99612718-238c-40dd-bd9c-f10d326aa097', '890ba6ce-0515-4472-9603-7d98e3f80438', 'b0bff2a3-3dbc-4ec6-bda3-067feab4ca15', 'e095053a-fc13-48a1-bbe7-e12e28af21c7'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:20 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-f27be86d-893d-4d8c-85e9-3a28e45406f6 tempest-GroupSnapshotsTest-28490446 None] group_snapshot c6b1531c-8efe-4ec5-8956-1a905dfc3c8b: deleted successfully Nov 06 10:49:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "cinder-quobyte-f799679e-aed0-4960-aeb2-2450f051c687" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-f799679e-aed0-4960-aeb2-2450f051c687" acquired by "delete_volume" :: waited 0.047s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:21 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e6519e-2d8c-47c7-aae5-059fc63df2a1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:49:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:21 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687 Nov 06 10:49:21 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:22 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687" returned: 0 in 0.664s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:22 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687 Nov 06 10:49:22 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:22 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f799679e-aed0-4960-aeb2-2450f051c687" returned: 0 in 0.330s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Lock "cinder-quobyte-f799679e-aed0-4960-aeb2-2450f051c687" released by "delete_volume" :: held 1.107s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:22 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Created reservations ['44548493-e2bd-4dfe-a980-64ec46cf9368'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:22 devstack cinder-volume[86819]: WARNING cinder.quota [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-118960257 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-118960257, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:49:22 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Created reservations ['36379378-4906-4397-abc5-7a66bf2ff78e', 'a2f920e1-9c73-4371-a7e1-d9670d22d48c', 'ffc6ccca-9ff9-405a-8514-44a32262c070', 'cda56029-ffc0-4059-ba3a-7e6a67ce9694'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:22 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:49:22 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:23 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.418s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:49:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-66bd080f-2f15-4130-baf1-1ea7bf68ccfe tempest-GroupSnapshotsTest-28490446 None] Delete group completed successfully. Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-a20005cd-c0f0-4fa8-85db-9025e7390167 req-238d8e90-7ff5-4fad-9ecd-6ae546a66651 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-a20005cd-c0f0-4fa8-85db-9025e7390167 req-238d8e90-7ff5-4fad-9ecd-6ae546a66651 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Flow 'volume_create_manager' (64d62520-0335-4bdb-bfb4-e885f59a0327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c21b82b-94a0-43dd-a526-ee6c4b65eb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-a20005cd-c0f0-4fa8-85db-9025e7390167 req-238d8e90-7ff5-4fad-9ecd-6ae546a66651 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c21b82b-94a0-43dd-a526-ee6c4b65eb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-553291580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d5c5a4-403e-456a-abbd-92c7260824d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5afee785d0343f9b79507193bd5e46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:23Z,use_quota=True,user_id='aee697a63b8a450bbe8902dfa4761f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89976d09-3742-4b1b-9d09-fe1af1ea7f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89976d09-3742-4b1b-9d09-fe1af1ea7f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d1d3a5-66fa-4343-bcde-df00dd9106dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d1d3a5-66fa-4343-bcde-df00dd9106dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d5c5a4-403e-456a-abbd-92c7260824d1', 'volume_name': 'volume-21d5c5a4-403e-456a-abbd-92c7260824d1', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb62c739-b59e-4d9c-80d8-58924d7880e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb62c739-b59e-4d9c-80d8-58924d7880e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895f7c67-09fb-4a81-bf86-caa041f435d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:23 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Volume 21d5c5a4-403e-456a-abbd-92c7260824d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d5c5a4-403e-456a-abbd-92c7260824d1', 'volume_size': 1} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-553291580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d5c5a4-403e-456a-abbd-92c7260824d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5afee785d0343f9b79507193bd5e46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:23Z,use_quota=True,user_id='aee697a63b8a450bbe8902dfa4761f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Creating volume 21d5c5a4-403e-456a-abbd-92c7260824d1 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:49:23 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21d5c5a4-403e-456a-abbd-92c7260824d1 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:23 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21d5c5a4-403e-456a-abbd-92c7260824d1 1073741824 Nov 06 10:49:23 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-a20005cd-c0f0-4fa8-85db-9025e7390167 req-238d8e90-7ff5-4fad-9ecd-6ae546a66651 tempest-TestInstancesWithCinderVolumes-1974923323 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-9f1cb867-a798-43dd-985b-2d01b4760112', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3228c942-efd1-43a7-9d12-27c662a7907e', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:49:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-a20005cd-c0f0-4fa8-85db-9025e7390167 req-238d8e90-7ff5-4fad-9ecd-6ae546a66651 tempest-TestInstancesWithCinderVolumes-1974923323 None] attachment_update completed successfully. Nov 06 10:49:24 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21d5c5a4-403e-456a-abbd-92c7260824d1 1073741824" returned: 0 in 0.757s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21d5c5a4-403e-456a-abbd-92c7260824d1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:24 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21d5c5a4-403e-456a-abbd-92c7260824d1 Nov 06 10:49:24 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:24 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21d5c5a4-403e-456a-abbd-92c7260824d1" returned: 0 in 0.373s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:49:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895f7c67-09fb-4a81-bf86-caa041f435d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d5c5a4-403e-456a-abbd-92c7260824d1', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fac131-32a9-4951-8e83-5e63d0223602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:24 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Volume volume-21d5c5a4-403e-456a-abbd-92c7260824d1 (21d5c5a4-403e-456a-abbd-92c7260824d1): created successfully Nov 06 10:49:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fac131-32a9-4951-8e83-5e63d0223602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Flow 'volume_create_manager' (64d62520-0335-4bdb-bfb4-e885f59a0327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:24 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-55ac9d8e-8c5a-4ea1-82dd-48a464a3a631 tempest-VolumesActionsTest-1019662994 None] Created volume successfully. Nov 06 10:49:25 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Acquiring lock "cinder-21d5c5a4-403e-456a-abbd-92c7260824d1-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:25 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Lock "cinder-21d5c5a4-403e-456a-abbd-92c7260824d1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:25 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Acquiring lock "cinder-quobyte-21d5c5a4-403e-456a-abbd-92c7260824d1" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:25 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Lock "cinder-quobyte-21d5c5a4-403e-456a-abbd-92c7260824d1" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:25 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c265e6-71b0-4ebd-b15b-686597efab55]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:49:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21d5c5a4-403e-456a-abbd-92c7260824d1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:26 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21d5c5a4-403e-456a-abbd-92c7260824d1 Nov 06 10:49:26 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:26 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21d5c5a4-403e-456a-abbd-92c7260824d1" returned: 0 in 0.616s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21d5c5a4-403e-456a-abbd-92c7260824d1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:26 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21d5c5a4-403e-456a-abbd-92c7260824d1 Nov 06 10:49:26 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-b9898671-572d-47b4-8d1a-4b09eb601f3d req-46c65182-ddf7-45d6-89cb-a238b8f1b0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-b9898671-572d-47b4-8d1a-4b09eb601f3d req-46c65182-ddf7-45d6-89cb-a238b8f1b0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-b9898671-572d-47b4-8d1a-4b09eb601f3d req-46c65182-ddf7-45d6-89cb-a238b8f1b0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-b9898671-572d-47b4-8d1a-4b09eb601f3d req-46c65182-ddf7-45d6-89cb-a238b8f1b0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-15950b55-596d-4f59-af76-49734841e657', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48c6b90c-f894-4b35-a094-57d259d96112', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:49:26 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21d5c5a4-403e-456a-abbd-92c7260824d1" returned: 0 in 0.497s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Lock "cinder-quobyte-21d5c5a4-403e-456a-abbd-92c7260824d1" released by "delete_volume" :: held 1.174s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:27 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-b9898671-572d-47b4-8d1a-4b09eb601f3d req-46c65182-ddf7-45d6-89cb-a238b8f1b0c0 tempest-TestInstancesWithCinderVolumes-1974923323 None] attachment_update completed successfully. Nov 06 10:49:27 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Created reservations ['352e2549-3ef3-4aef-b723-0bab118bb065', '1c0c17bc-3c6a-4200-9bba-b4f8646c23b5', 'e6d3ca7a-6839-41a7-984e-51e08667d7d2', '1bd6242d-7f68-40a0-8269-69cc6241c450'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:27 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:49:27 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:27 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.535s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:27 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:49:27 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Deleted volume successfully. Nov 06 10:49:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0a98d081-f168-404f-a545-ff8c073da3b5 tempest-VolumesActionsTest-368697794 None] Lock "cinder-21d5c5a4-403e-456a-abbd-92c7260824d1-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Flow 'volume_create_manager' (e866234e-8fad-4fe6-b1bd-dd6fc403a401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682ce392-c743-42b8-9166-1d1948a6f9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682ce392-c743-42b8-9166-1d1948a6f9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-163497070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092fa07c-64b3-4d24-83f2-0827dc446b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5afee785d0343f9b79507193bd5e46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:29Z,use_quota=True,user_id='aee697a63b8a450bbe8902dfa4761f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cdfcdb-91eb-4a69-be1a-f282ffdb4de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cdfcdb-91eb-4a69-be1a-f282ffdb4de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c54c2c2-7ec4-44ec-8d1b-cd6039062996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c54c2c2-7ec4-44ec-8d1b-cd6039062996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '092fa07c-64b3-4d24-83f2-0827dc446b8b', 'volume_name': 'volume-092fa07c-64b3-4d24-83f2-0827dc446b8b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a72b883-d761-42d6-a869-8a9b3b87f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a72b883-d761-42d6-a869-8a9b3b87f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70fa2a63-42f2-4986-bfe7-6d0d561204e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:28 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Volume 092fa07c-64b3-4d24-83f2-0827dc446b8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-092fa07c-64b3-4d24-83f2-0827dc446b8b', 'volume_size': 1} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-163497070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092fa07c-64b3-4d24-83f2-0827dc446b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5afee785d0343f9b79507193bd5e46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:29Z,use_quota=True,user_id='aee697a63b8a450bbe8902dfa4761f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Creating volume 092fa07c-64b3-4d24-83f2-0827dc446b8b {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:49:28 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:49:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-092fa07c-64b3-4d24-83f2-0827dc446b8b 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:28 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-092fa07c-64b3-4d24-83f2-0827dc446b8b 1073741824 Nov 06 10:49:28 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:29 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-092fa07c-64b3-4d24-83f2-0827dc446b8b 1073741824" returned: 0 in 0.591s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-092fa07c-64b3-4d24-83f2-0827dc446b8b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:29 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-092fa07c-64b3-4d24-83f2-0827dc446b8b Nov 06 10:49:29 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:29 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-092fa07c-64b3-4d24-83f2-0827dc446b8b" returned: 0 in 0.306s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:49:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70fa2a63-42f2-4986-bfe7-6d0d561204e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-092fa07c-64b3-4d24-83f2-0827dc446b8b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3714670-34ca-44e8-8757-da0d36f24827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:29 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Volume volume-092fa07c-64b3-4d24-83f2-0827dc446b8b (092fa07c-64b3-4d24-83f2-0827dc446b8b): created successfully Nov 06 10:49:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3714670-34ca-44e8-8757-da0d36f24827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Flow 'volume_create_manager' (e866234e-8fad-4fe6-b1bd-dd6fc403a401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:29 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-fd890322-de94-4f38-b6db-0007ad001b3b tempest-VolumesActionsTest-1019662994 None] Created volume successfully. Nov 06 10:49:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Acquiring lock "cinder-092fa07c-64b3-4d24-83f2-0827dc446b8b-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Lock "cinder-092fa07c-64b3-4d24-83f2-0827dc446b8b-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Acquiring lock "cinder-quobyte-092fa07c-64b3-4d24-83f2-0827dc446b8b" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Lock "cinder-quobyte-092fa07c-64b3-4d24-83f2-0827dc446b8b" acquired by "delete_volume" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:31 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5697fab0-e582-4e5b-acbe-ce2b0d81ca13]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:49:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-092fa07c-64b3-4d24-83f2-0827dc446b8b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:31 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-092fa07c-64b3-4d24-83f2-0827dc446b8b Nov 06 10:49:31 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:31 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-092fa07c-64b3-4d24-83f2-0827dc446b8b" returned: 0 in 0.464s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-092fa07c-64b3-4d24-83f2-0827dc446b8b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:31 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-092fa07c-64b3-4d24-83f2-0827dc446b8b Nov 06 10:49:31 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:31 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-092fa07c-64b3-4d24-83f2-0827dc446b8b" returned: 0 in 0.355s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Lock "cinder-quobyte-092fa07c-64b3-4d24-83f2-0827dc446b8b" released by "delete_volume" :: held 0.895s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:32 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Created reservations ['524161af-14f8-4a99-804f-36a7d1f1937e', 'cf71a9f8-56f6-40bd-bfea-c4ea8a937f46', '9609b9be-77d3-441f-8173-2c5838cb2580', '9a727e67-f842-42fb-b03e-a60012d85db5'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:32 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:49:32 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:32 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.324s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:32 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:49:32 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Deleted volume successfully. Nov 06 10:49:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cdefaab0-4599-4e56-b4ef-73fcffd848d3 tempest-VolumesActionsTest-368697794 None] Lock "cinder-092fa07c-64b3-4d24-83f2-0827dc446b8b-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:32 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:49:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Flow 'volume_create_manager' (648b7928-2360-457c-abe8-73e22bb46c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ddf61a-6f3a-4c42-8145-4293d1328d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ddf61a-6f3a-4c42-8145-4293d1328d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-682159387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400cdf2c-0872-4b84-a2e3-c9993a921db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5afee785d0343f9b79507193bd5e46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:33Z,use_quota=True,user_id='aee697a63b8a450bbe8902dfa4761f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188a2f6f-d1c6-4f27-9623-4321bad2965e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188a2f6f-d1c6-4f27-9623-4321bad2965e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc1c003-29b1-4ddb-995b-d669d7df254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc1c003-29b1-4ddb-995b-d669d7df254b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '400cdf2c-0872-4b84-a2e3-c9993a921db1', 'volume_name': 'volume-400cdf2c-0872-4b84-a2e3-c9993a921db1', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (debcf85f-5cad-4d0e-8e33-0b49d3785056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (debcf85f-5cad-4d0e-8e33-0b49d3785056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6200d49b-cbda-4238-8fb3-ff827d9466e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:33 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Volume 400cdf2c-0872-4b84-a2e3-c9993a921db1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-400cdf2c-0872-4b84-a2e3-c9993a921db1', 'volume_size': 1} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-682159387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400cdf2c-0872-4b84-a2e3-c9993a921db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5afee785d0343f9b79507193bd5e46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:33Z,use_quota=True,user_id='aee697a63b8a450bbe8902dfa4761f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Creating volume 400cdf2c-0872-4b84-a2e3-c9993a921db1 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:49:33 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-400cdf2c-0872-4b84-a2e3-c9993a921db1 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:33 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-400cdf2c-0872-4b84-a2e3-c9993a921db1 1073741824 Nov 06 10:49:33 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:33 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-711d3d0c-10e5-4eb8-b4cd-1fe84383bf90 req-958825ee-1a2d-4db9-8c60-7d6dc306ac9c tempest-TestInstancesWithCinderVolumes-1974923323 None] Terminate volume connection completed successfully. Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-711d3d0c-10e5-4eb8-b4cd-1fe84383bf90 req-958825ee-1a2d-4db9-8c60-7d6dc306ac9c tempest-TestInstancesWithCinderVolumes-1974923323 None] Deleting attachment 3228c942-efd1-43a7-9d12-27c662a7907e. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:49:33 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-400cdf2c-0872-4b84-a2e3-c9993a921db1 1073741824" returned: 0 in 0.584s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-400cdf2c-0872-4b84-a2e3-c9993a921db1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:33 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-400cdf2c-0872-4b84-a2e3-c9993a921db1 Nov 06 10:49:33 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:34 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-400cdf2c-0872-4b84-a2e3-c9993a921db1" returned: 0 in 0.367s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:49:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6200d49b-cbda-4238-8fb3-ff827d9466e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-400cdf2c-0872-4b84-a2e3-c9993a921db1', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fdba98-6265-4daa-b1bd-ce001f11b379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:34 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Volume volume-400cdf2c-0872-4b84-a2e3-c9993a921db1 (400cdf2c-0872-4b84-a2e3-c9993a921db1): created successfully Nov 06 10:49:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fdba98-6265-4daa-b1bd-ce001f11b379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Flow 'volume_create_manager' (648b7928-2360-457c-abe8-73e22bb46c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:34 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-195a66ec-e1c5-4654-9f4b-bfd1f0b96620 tempest-VolumesActionsTest-1019662994 None] Created volume successfully. Nov 06 10:49:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "cinder-9f1cb867-a798-43dd-985b-2d01b4760112-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "cinder-9f1cb867-a798-43dd-985b-2d01b4760112-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "cinder-quobyte-9f1cb867-a798-43dd-985b-2d01b4760112" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "cinder-quobyte-9f1cb867-a798-43dd-985b-2d01b4760112" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:34 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a173a9b-1e72-4f03-8d11-053371005869]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:49:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9f1cb867-a798-43dd-985b-2d01b4760112 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:34 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9f1cb867-a798-43dd-985b-2d01b4760112 Nov 06 10:49:34 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:35 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9f1cb867-a798-43dd-985b-2d01b4760112" returned: 0 in 0.628s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9f1cb867-a798-43dd-985b-2d01b4760112 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:35 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9f1cb867-a798-43dd-985b-2d01b4760112 Nov 06 10:49:35 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:35 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9f1cb867-a798-43dd-985b-2d01b4760112" returned: 0 in 0.534s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Acquiring lock "cinder-400cdf2c-0872-4b84-a2e3-c9993a921db1-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "cinder-quobyte-9f1cb867-a798-43dd-985b-2d01b4760112" released by "delete_volume" :: held 1.302s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Lock "cinder-400cdf2c-0872-4b84-a2e3-c9993a921db1-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:35 devstack cinder-volume[86819]: WARNING cinder.quota [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-605305201-1725339808 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-605305201-1725339808, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:49:35 devstack cinder-volume[86819]: WARNING cinder.quota [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-605305201-1725339808 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-605305201-1725339808, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Acquiring lock "cinder-quobyte-400cdf2c-0872-4b84-a2e3-c9993a921db1" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Lock "cinder-quobyte-400cdf2c-0872-4b84-a2e3-c9993a921db1" acquired by "delete_volume" :: waited 0.034s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Created reservations ['d3d7ff82-891d-4dec-82a7-d97565722bb0', '43b8d148-762f-478e-8a5e-8a954542c6d7', 'b05b9d0a-711c-43d4-a857-1c6dccff0754', 'fa59e487-379f-4541-879f-a7c731734f6f'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db21173-3017-4797-b7c2-f18fc4cabd0b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-400cdf2c-0872-4b84-a2e3-c9993a921db1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:35 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:49:35 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:36 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-400cdf2c-0872-4b84-a2e3-c9993a921db1 Nov 06 10:49:36 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:36 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:49:36 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:36 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.472s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:49:36 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Deleted volume successfully. Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fba4cdba-0de2-4e4c-8583-c8d605446b80 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "cinder-9f1cb867-a798-43dd-985b-2d01b4760112-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:36 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-400cdf2c-0872-4b84-a2e3-c9993a921db1" returned: 0 in 0.755s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-400cdf2c-0872-4b84-a2e3-c9993a921db1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:36 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.478s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:49:36 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-400cdf2c-0872-4b84-a2e3-c9993a921db1 Nov 06 10:49:36 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 28 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:49:36 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-400cdf2c-0872-4b84-a2e3-c9993a921db1" returned: 0 in 0.392s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Lock "cinder-quobyte-400cdf2c-0872-4b84-a2e3-c9993a921db1" released by "delete_volume" :: held 1.230s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:37 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Created reservations ['22b44cea-bd61-4f51-bf1c-827e3866478c', '48c1deb5-f546-4dd6-bf91-4c775463a15b', 'd5570c16-6b4f-47ab-a393-dfefe9e23b69', 'd4d68d55-a406-4be8-a422-6c4fb1221595'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:37 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:49:37 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:37 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.466s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:37 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:49:37 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Deleted volume successfully. Nov 06 10:49:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ac71cdb9-a7be-4d72-9e28-c05f523ca13e tempest-VolumesActionsTest-368697794 None] Lock "cinder-400cdf2c-0872-4b84-a2e3-c9993a921db1-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Flow 'volume_create_manager' (b9be06a5-65a1-42aa-8df9-f49657d9d2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46403f7-97ee-4e3d-9ecc-21969c738797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46403f7-97ee-4e3d-9ecc-21969c738797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2128302708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09f590b-0f89-4b1d-9274-79e26851dd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5afee785d0343f9b79507193bd5e46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:39Z,use_quota=True,user_id='aee697a63b8a450bbe8902dfa4761f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73f7059-4178-47a6-a375-85c8f8aede8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73f7059-4178-47a6-a375-85c8f8aede8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e106d8-b540-4ecb-9882-078fc18fe460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e106d8-b540-4ecb-9882-078fc18fe460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f09f590b-0f89-4b1d-9274-79e26851dd53', 'volume_name': 'volume-f09f590b-0f89-4b1d-9274-79e26851dd53', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c699ea50-d80f-4624-b000-83dd427967df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c699ea50-d80f-4624-b000-83dd427967df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf9abbaf-de79-436f-bff7-62f74e0ee76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:39 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Volume f09f590b-0f89-4b1d-9274-79e26851dd53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f09f590b-0f89-4b1d-9274-79e26851dd53', 'volume_size': 1} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2128302708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09f590b-0f89-4b1d-9274-79e26851dd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5afee785d0343f9b79507193bd5e46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:39Z,use_quota=True,user_id='aee697a63b8a450bbe8902dfa4761f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Creating volume f09f590b-0f89-4b1d-9274-79e26851dd53 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:49:39 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:49:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f09f590b-0f89-4b1d-9274-79e26851dd53 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:39 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f09f590b-0f89-4b1d-9274-79e26851dd53 1073741824 Nov 06 10:49:39 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:40 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-d650560f-182e-46c1-a4e9-685c3654e277 req-eea1d485-5d0a-4963-bab0-a8184a788e74 tempest-TestInstancesWithCinderVolumes-1974923323 None] Terminate volume connection completed successfully. Nov 06 10:49:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-d650560f-182e-46c1-a4e9-685c3654e277 req-eea1d485-5d0a-4963-bab0-a8184a788e74 tempest-TestInstancesWithCinderVolumes-1974923323 None] Deleting attachment 48c6b90c-f894-4b35-a094-57d259d96112. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:49:40 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f09f590b-0f89-4b1d-9274-79e26851dd53 1073741824" returned: 0 in 1.099s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f09f590b-0f89-4b1d-9274-79e26851dd53 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:40 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f09f590b-0f89-4b1d-9274-79e26851dd53 Nov 06 10:49:40 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "cinder-15950b55-596d-4f59-af76-49734841e657-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "cinder-15950b55-596d-4f59-af76-49734841e657-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:40 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f09f590b-0f89-4b1d-9274-79e26851dd53" returned: 0 in 0.417s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:49:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf9abbaf-de79-436f-bff7-62f74e0ee76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f09f590b-0f89-4b1d-9274-79e26851dd53', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d44095c-b22d-4f3b-8837-52da5a1cbb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "cinder-quobyte-15950b55-596d-4f59-af76-49734841e657" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:40 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Volume volume-f09f590b-0f89-4b1d-9274-79e26851dd53 (f09f590b-0f89-4b1d-9274-79e26851dd53): created successfully Nov 06 10:49:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d44095c-b22d-4f3b-8837-52da5a1cbb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Flow 'volume_create_manager' (b9be06a5-65a1-42aa-8df9-f49657d9d2bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:41 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "cinder-quobyte-15950b55-596d-4f59-af76-49734841e657" acquired by "delete_volume" :: waited 0.084s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:41 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9130a602-9866-47fa-bd4e-8e4d2268c2e3 tempest-VolumesActionsTest-1019662994 None] Created volume successfully. Nov 06 10:49:41 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a437a15-8d67-4215-9815-f65f5b97e5a4]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:49:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-15950b55-596d-4f59-af76-49734841e657 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:41 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-15950b55-596d-4f59-af76-49734841e657 Nov 06 10:49:41 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:41 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-15950b55-596d-4f59-af76-49734841e657" returned: 0 in 0.475s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-15950b55-596d-4f59-af76-49734841e657 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:41 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-15950b55-596d-4f59-af76-49734841e657 Nov 06 10:49:41 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:41 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-15950b55-596d-4f59-af76-49734841e657" returned: 0 in 0.393s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "cinder-quobyte-15950b55-596d-4f59-af76-49734841e657" released by "delete_volume" :: held 0.985s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:42 devstack cinder-volume[86819]: WARNING cinder.quota [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-429436937-436889100 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-429436937-436889100, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:49:42 devstack cinder-volume[86819]: WARNING cinder.quota [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-429436937-436889100 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-429436937-436889100, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:49:42 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Created reservations ['88082870-387c-49a8-9f9c-f57dd796c14e', 'f3ed8910-3868-469e-afe3-18482987bde4', '37250e10-ee5f-47c2-8a33-a973b74901de', '6364b742-730f-4b82-8d2f-013e08f349ef'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:42 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:49:42 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Acquiring lock "cinder-f09f590b-0f89-4b1d-9274-79e26851dd53-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Lock "cinder-f09f590b-0f89-4b1d-9274-79e26851dd53-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Acquiring lock "cinder-quobyte-f09f590b-0f89-4b1d-9274-79e26851dd53" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Lock "cinder-quobyte-f09f590b-0f89-4b1d-9274-79e26851dd53" acquired by "delete_volume" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:42 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4774fb6-bd65-4d87-9a03-39e17528c49c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:49:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f09f590b-0f89-4b1d-9274-79e26851dd53 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:43 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.657s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:43 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:49:43 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Deleted volume successfully. Nov 06 10:49:43 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e8d105e4-b630-44d2-8a8e-d5955a4f3e79 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "cinder-15950b55-596d-4f59-af76-49734841e657-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:43 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f09f590b-0f89-4b1d-9274-79e26851dd53 Nov 06 10:49:43 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:43 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f09f590b-0f89-4b1d-9274-79e26851dd53" returned: 0 in 0.796s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f09f590b-0f89-4b1d-9274-79e26851dd53 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:43 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f09f590b-0f89-4b1d-9274-79e26851dd53 Nov 06 10:49:43 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:43 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:49:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Flow 'volume_create_manager' (c8737c4a-51a2-45de-816c-55b03e308cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03e2d11-2320-4fd0-9e51-b694546c021a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03e2d11-2320-4fd0-9e51-b694546c021a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-334430369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b64bfc3de946a78dc68bf73c4c7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:44Z,use_quota=True,user_id='2ac58bc5f5b044d9a6d3f28f56fdd094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea33866-9f19-4294-b764-421f42210f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea33866-9f19-4294-b764-421f42210f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af75cfb2-be5f-44a5-9233-b4957308a0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af75cfb2-be5f-44a5-9233-b4957308a0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0', 'volume_name': 'volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a719bc-7bb5-40dd-91ca-6f83397fd6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a719bc-7bb5-40dd-91ca-6f83397fd6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6502d03-5302-4d2a-b96d-b9e25cc59b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:44 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Volume d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0', 'volume_size': 1} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-334430369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b64bfc3de946a78dc68bf73c4c7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:44Z,use_quota=True,user_id='2ac58bc5f5b044d9a6d3f28f56fdd094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Creating volume d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:49:44 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:44 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0 1073741824 Nov 06 10:49:44 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:44 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f09f590b-0f89-4b1d-9274-79e26851dd53" returned: 0 in 0.701s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Lock "cinder-quobyte-f09f590b-0f89-4b1d-9274-79e26851dd53" released by "delete_volume" :: held 1.630s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Created reservations ['acc3a49c-a8d0-45f1-a9e6-f91704de8e0f', '771b7724-ccf7-4a44-889b-d67db656a4c7', '593b68d9-6b4d-4d06-acc7-d38d95b2d0a7', '4c17ae5d-78fb-4603-8d36-510821326ec9'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG oslo_db.api [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 06 10:49:44 devstack cinder-volume[86819]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at Nov 06 10:49:44 devstack cinder-volume[86819]: FROM reservations Nov 06 10:49:44 devstack cinder-volume[86819]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s) FOR UPDATE] Nov 06 10:49:44 devstack cinder-volume[86819]: [parameters: {'uuid_1_1': 'acc3a49c-a8d0-45f1-a9e6-f91704de8e0f', 'uuid_1_2': '771b7724-ccf7-4a44-889b-d67db656a4c7', 'uuid_1_3': '593b68d9-6b4d-4d06-acc7-d38d95b2d0a7', 'uuid_1_4': '4c17ae5d-78fb-4603-8d36-510821326ec9'}] Nov 06 10:49:44 devstack cinder-volume[86819]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=86819) _is_exception_expected /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:184}} Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG oslo_db.api [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Performing DB retry for function cinder.db.api.reservation_commit {{(pid=86819) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}} Nov 06 10:49:44 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2435e1e6-ee62-4e04-a905-e3e76fc38974 tempest-GroupsV320Test-1375006324 None] Group tempest-GroupsV320Test-Group-1806138882: creating Nov 06 10:49:44 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0 1073741824" returned: 0 in 0.786s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:44 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2435e1e6-ee62-4e04-a905-e3e76fc38974 tempest-GroupsV320Test-1375006324 None] Group tempest-GroupsV320Test-Group-1806138882: created successfully Nov 06 10:49:45 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2435e1e6-ee62-4e04-a905-e3e76fc38974 tempest-GroupsV320Test-1375006324 None] Create group completed successfully. Nov 06 10:49:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:45 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0 Nov 06 10:49:45 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:45 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0" returned: 0 in 0.364s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:49:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6502d03-5302-4d2a-b96d-b9e25cc59b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df032e15-409b-47a7-9416-b47dade5ab29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:45 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Volume volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0 (d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0): created successfully Nov 06 10:49:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df032e15-409b-47a7-9416-b47dade5ab29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Flow 'volume_create_manager' (c8737c4a-51a2-45de-816c-55b03e308cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:45 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2f89755e-cb1f-4c4a-893e-9efb4659194f tempest-TestMinimumBasicScenario-192056331 None] Created volume successfully. Nov 06 10:49:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:45 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:49:45 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:46 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.461s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:46 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:49:46 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Deleted volume successfully. Nov 06 10:49:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3ec2eb14-d346-46b1-b343-de04e7172ffd tempest-VolumesActionsTest-368697794 None] Lock "cinder-f09f590b-0f89-4b1d-9274-79e26851dd53-delete_volume" released by "delete_volume" :: held 3.722s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:46 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:49:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Flow 'volume_create_manager' (1a5cb794-2e50-4528-ba8c-1c2e42d9f343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa253085-9542-4f60-8205-8ed54d9e6560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa253085-9542-4f60-8205-8ed54d9e6560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-459004657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b397b9f-214d-4334-b20c-66a7c018ea53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5afee785d0343f9b79507193bd5e46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:47Z,use_quota=True,user_id='aee697a63b8a450bbe8902dfa4761f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f230c48f-4700-4ad2-940a-6110312e12f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f230c48f-4700-4ad2-940a-6110312e12f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d951a9-0a81-493f-95cc-7a99384666be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d951a9-0a81-493f-95cc-7a99384666be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b397b9f-214d-4334-b20c-66a7c018ea53', 'volume_name': 'volume-3b397b9f-214d-4334-b20c-66a7c018ea53', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1c5b23-a714-4131-8eef-31816bd08e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1c5b23-a714-4131-8eef-31816bd08e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb3075d-ae5c-41ee-98bd-ba1e41f6a058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:47 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Volume 3b397b9f-214d-4334-b20c-66a7c018ea53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b397b9f-214d-4334-b20c-66a7c018ea53', 'volume_size': 1} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-459004657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b397b9f-214d-4334-b20c-66a7c018ea53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5afee785d0343f9b79507193bd5e46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:49:47Z,use_quota=True,user_id='aee697a63b8a450bbe8902dfa4761f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Creating volume 3b397b9f-214d-4334-b20c-66a7c018ea53 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:49:47 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3b397b9f-214d-4334-b20c-66a7c018ea53 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:47 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3b397b9f-214d-4334-b20c-66a7c018ea53 1073741824 Nov 06 10:49:47 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-7c677999-289a-4bdd-9c9a-edd9ead69c9a tempest-GroupsV320Test-1375006324 None] Created reservations ['6b6682e7-2d90-40af-a594-5ad016a65a4c'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7c677999-289a-4bdd-9c9a-edd9ead69c9a tempest-GroupsV320Test-1375006324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7c677999-289a-4bdd-9c9a-edd9ead69c9a tempest-GroupsV320Test-1375006324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7c677999-289a-4bdd-9c9a-edd9ead69c9a tempest-GroupsV320Test-1375006324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7c677999-289a-4bdd-9c9a-edd9ead69c9a tempest-GroupsV320Test-1375006324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7c677999-289a-4bdd-9c9a-edd9ead69c9a tempest-GroupsV320Test-1375006324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7c677999-289a-4bdd-9c9a-edd9ead69c9a tempest-GroupsV320Test-1375006324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:47 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:49:47 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:48 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3b397b9f-214d-4334-b20c-66a7c018ea53 1073741824" returned: 0 in 1.146s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:48 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7c677999-289a-4bdd-9c9a-edd9ead69c9a tempest-GroupsV320Test-1375006324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.550s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-7c677999-289a-4bdd-9c9a-edd9ead69c9a tempest-GroupsV320Test-1375006324 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:49:48 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-cdc4feb8-6cf9-4eae-8d6a-269dbd551ede req-fe26b726-f0b1-499e-88cc-9cff8f542b13 tempest-TestInstancesWithCinderVolumes-1974923323 None] Terminate volume connection completed successfully. Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-cdc4feb8-6cf9-4eae-8d6a-269dbd551ede req-fe26b726-f0b1-499e-88cc-9cff8f542b13 tempest-TestInstancesWithCinderVolumes-1974923323 None] Deleting attachment b520f097-8a2c-4e4d-99d3-4127b5ad6c71. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:49:48 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7c677999-289a-4bdd-9c9a-edd9ead69c9a tempest-GroupsV320Test-1375006324 None] Delete group completed successfully. Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-07be8783-4e44-49e0-a8a7-25c2b11f50ea req-e88990e5-cbf9-48ab-892a-5775b17115e8 tempest-TestMinimumBasicScenario-192056331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3b397b9f-214d-4334-b20c-66a7c018ea53 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:48 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3b397b9f-214d-4334-b20c-66a7c018ea53 Nov 06 10:49:48 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:48 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3b397b9f-214d-4334-b20c-66a7c018ea53" returned: 0 in 0.462s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-07be8783-4e44-49e0-a8a7-25c2b11f50ea req-e88990e5-cbf9-48ab-892a-5775b17115e8 tempest-TestMinimumBasicScenario-192056331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.480s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb3075d-ae5c-41ee-98bd-ba1e41f6a058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b397b9f-214d-4334-b20c-66a7c018ea53', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa6d402-f848-4486-b990-84bd20fd2979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-07be8783-4e44-49e0-a8a7-25c2b11f50ea req-e88990e5-cbf9-48ab-892a-5775b17115e8 tempest-TestMinimumBasicScenario-192056331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.078s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:48 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Volume volume-3b397b9f-214d-4334-b20c-66a7c018ea53 (3b397b9f-214d-4334-b20c-66a7c018ea53): created successfully Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa6d402-f848-4486-b990-84bd20fd2979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Flow 'volume_create_manager' (1a5cb794-2e50-4528-ba8c-1c2e42d9f343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:49:48 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d7eb1adb-5d2b-4a2f-8ec9-24330a8ec513 tempest-VolumesActionsTest-1019662994 None] Created volume successfully. Nov 06 10:49:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-07be8783-4e44-49e0-a8a7-25c2b11f50ea req-e88990e5-cbf9-48ab-892a-5775b17115e8 tempest-TestMinimumBasicScenario-192056331 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd443f436-0d3f-4b58-a1d8-ab6685470ed2', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:49:48 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-07be8783-4e44-49e0-a8a7-25c2b11f50ea req-e88990e5-cbf9-48ab-892a-5775b17115e8 tempest-TestMinimumBasicScenario-192056331 None] attachment_update completed successfully. Nov 06 10:49:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "cinder-dc528370-0c1d-42a7-beb7-9a80bbb576c4-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "cinder-dc528370-0c1d-42a7-beb7-9a80bbb576c4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "cinder-quobyte-dc528370-0c1d-42a7-beb7-9a80bbb576c4" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "cinder-quobyte-dc528370-0c1d-42a7-beb7-9a80bbb576c4" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:50 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bdd496-910b-42eb-82cf-1a0fbfcd81d7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:49:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:50 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 Nov 06 10:49:50 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:50 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4" returned: 0 in 0.543s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Acquiring lock "cinder-3b397b9f-214d-4334-b20c-66a7c018ea53-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:50 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4 Nov 06 10:49:50 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Lock "cinder-3b397b9f-214d-4334-b20c-66a7c018ea53-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Acquiring lock "cinder-quobyte-3b397b9f-214d-4334-b20c-66a7c018ea53" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:49:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Lock "cinder-quobyte-3b397b9f-214d-4334-b20c-66a7c018ea53" acquired by "delete_volume" :: waited 0.042s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:49:50 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e064bf-fddf-4853-ba59-4fec61aea74e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:49:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3b397b9f-214d-4334-b20c-66a7c018ea53 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:50 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3b397b9f-214d-4334-b20c-66a7c018ea53 Nov 06 10:49:50 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:51 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-dc528370-0c1d-42a7-beb7-9a80bbb576c4" returned: 0 in 0.469s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "cinder-quobyte-dc528370-0c1d-42a7-beb7-9a80bbb576c4" released by "delete_volume" :: held 1.084s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:51 devstack cinder-volume[86819]: WARNING cinder.quota [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-731154316-1100804112 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-731154316-1100804112, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:49:51 devstack cinder-volume[86819]: WARNING cinder.quota [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-731154316-1100804112 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-731154316-1100804112, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Created reservations ['06f1e00f-5086-4b02-92af-62c48f3b8c68', 'bc3cf53d-a57d-4c26-addd-581a23dc5fa4', '1052a39f-2258-4b4e-868c-f335a28283ec', 'f18f6421-2064-4de2-9fe5-d118d36c2368'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:51 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:49:51 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:51 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3b397b9f-214d-4334-b20c-66a7c018ea53" returned: 0 in 0.600s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3b397b9f-214d-4334-b20c-66a7c018ea53 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:51 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3b397b9f-214d-4334-b20c-66a7c018ea53 Nov 06 10:49:51 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:51 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.332s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:49:51 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Deleted volume successfully. Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-858c38b3-ae96-4726-b1e1-b8f69ae33657 tempest-TestInstancesWithCinderVolumes-1974923323 None] Lock "cinder-dc528370-0c1d-42a7-beb7-9a80bbb576c4-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:51 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3b397b9f-214d-4334-b20c-66a7c018ea53" returned: 0 in 0.472s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Lock "cinder-quobyte-3b397b9f-214d-4334-b20c-66a7c018ea53" released by "delete_volume" :: held 1.143s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:49:51 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Created reservations ['c2169d7e-260b-43b4-ac51-f990062907d0', '8df56925-c180-4a97-aa2b-43f9ee6293d1', '363d8883-45f2-4f87-9abb-7212c6bf01de', '57ab81b7-657b-4ccf-af2d-2eb978c2d459'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:49:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:49:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:49:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:49:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:49:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:49:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:49:52 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:49:52 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:49:52 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Nov 06 10:49:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.358s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:49:52 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:49:52 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Deleted volume successfully. Nov 06 10:49:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e8b9ac5-d256-4b0a-9842-f5a162e242ef tempest-VolumesActionsTest-1019662994 None] Lock "cinder-3b397b9f-214d-4334-b20c-66a7c018ea53-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:01 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=133,cinder:SELECT=145,cinder:INSERT=36,cinder:DELETE=7 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:50:02 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=122,cinder:UPDATE=159,cinder:INSERT=30,cinder:DELETE=10 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Flow 'volume_create_manager' (974de43c-53b8-49e5-9d9a-71bb11501395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7942cf46-7f6d-449c-b78e-1953c9747f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7942cf46-7f6d-449c-b78e-1953c9747f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1967916227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ea9b10-b7b1-463d-9147-2702161e234f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108aaf6e16e345a7abba14e612e42466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:13Z,use_quota=True,user_id='85192f9428dc48b3b635ed21446fdaf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(074a0678-4ae1-4e3b-8f08-f73c0fa6436e),volume_type_id=074a0678-4ae1-4e3b-8f08-f73c0fa6436e)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2302c80-35e3-4476-a518-f9418bc40960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2302c80-35e3-4476-a518-f9418bc40960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c42a3b-76c8-4cee-a71e-d73cb26c59af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c42a3b-76c8-4cee-a71e-d73cb26c59af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ea9b10-b7b1-463d-9147-2702161e234f', 'volume_name': 'volume-a0ea9b10-b7b1-463d-9147-2702161e234f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cbcf19b-49df-4131-8163-69e2e1f8ef0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cbcf19b-49df-4131-8163-69e2e1f8ef0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940f874c-1f93-4456-bd83-569a4f1c8a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:13 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Volume a0ea9b10-b7b1-463d-9147-2702161e234f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ea9b10-b7b1-463d-9147-2702161e234f', 'volume_size': 1} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1967916227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ea9b10-b7b1-463d-9147-2702161e234f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108aaf6e16e345a7abba14e612e42466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:13Z,use_quota=True,user_id='85192f9428dc48b3b635ed21446fdaf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(074a0678-4ae1-4e3b-8f08-f73c0fa6436e),volume_type_id=074a0678-4ae1-4e3b-8f08-f73c0fa6436e)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Creating volume a0ea9b10-b7b1-463d-9147-2702161e234f {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:50:13 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:50:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a0ea9b10-b7b1-463d-9147-2702161e234f 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:13 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a0ea9b10-b7b1-463d-9147-2702161e234f 1073741824 Nov 06 10:50:13 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:14 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a0ea9b10-b7b1-463d-9147-2702161e234f 1073741824" returned: 0 in 0.682s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a0ea9b10-b7b1-463d-9147-2702161e234f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:14 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a0ea9b10-b7b1-463d-9147-2702161e234f Nov 06 10:50:14 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:14 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a0ea9b10-b7b1-463d-9147-2702161e234f" returned: 0 in 0.297s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:50:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940f874c-1f93-4456-bd83-569a4f1c8a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ea9b10-b7b1-463d-9147-2702161e234f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb46b70-9408-4def-837f-5d58f47c974d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:14 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Volume volume-a0ea9b10-b7b1-463d-9147-2702161e234f (a0ea9b10-b7b1-463d-9147-2702161e234f): created successfully Nov 06 10:50:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb46b70-9408-4def-837f-5d58f47c974d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Flow 'volume_create_manager' (974de43c-53b8-49e5-9d9a-71bb11501395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:14 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-06bddf7c-7de2-47e2-9298-e2abdb2407ef tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Created volume successfully. Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Flow 'volume_create_manager' (01f585a8-2e2e-4176-be85-8f42471d1590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b0f079-152b-4ef1-bc21-369552c012f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b0f079-152b-4ef1-bc21-369552c012f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-398406841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d61d37-055d-4bac-8ea4-091af2ffc644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2fe7bb21f14543a0e0da1620a4a730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:15Z,use_quota=True,user_id='6aa66c0bc61148efbda7c617b2000ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5db9d9-0d30-47f4-b9ae-8e73e819cc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5db9d9-0d30-47f4-b9ae-8e73e819cc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c131bd1a-db29-4bb7-9da4-e458aa7f5032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c131bd1a-db29-4bb7-9da4-e458aa7f5032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3d61d37-055d-4bac-8ea4-091af2ffc644', 'volume_name': 'volume-c3d61d37-055d-4bac-8ea4-091af2ffc644', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e340e0-03ad-412f-9b2a-d14fa8eeef09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e340e0-03ad-412f-9b2a-d14fa8eeef09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68049df3-2936-45ee-8701-03f8dca9444a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:15 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Volume c3d61d37-055d-4bac-8ea4-091af2ffc644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3d61d37-055d-4bac-8ea4-091af2ffc644', 'volume_size': 1} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-398406841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d61d37-055d-4bac-8ea4-091af2ffc644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2fe7bb21f14543a0e0da1620a4a730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:15Z,use_quota=True,user_id='6aa66c0bc61148efbda7c617b2000ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Creating volume c3d61d37-055d-4bac-8ea4-091af2ffc644 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:50:15 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3d61d37-055d-4bac-8ea4-091af2ffc644 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:15 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3d61d37-055d-4bac-8ea4-091af2ffc644 1073741824 Nov 06 10:50:15 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:15 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3d61d37-055d-4bac-8ea4-091af2ffc644 1073741824" returned: 0 in 0.547s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3d61d37-055d-4bac-8ea4-091af2ffc644 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:15 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3d61d37-055d-4bac-8ea4-091af2ffc644 Nov 06 10:50:15 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-382c69d5-00e3-4096-bd1c-21dc367eecd5 tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-382c69d5-00e3-4096-bd1c-21dc367eecd5 tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-382c69d5-00e3-4096-bd1c-21dc367eecd5 tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-382c69d5-00e3-4096-bd1c-21dc367eecd5 tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-382c69d5-00e3-4096-bd1c-21dc367eecd5 tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-382c69d5-00e3-4096-bd1c-21dc367eecd5 tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:16 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3d61d37-055d-4bac-8ea4-091af2ffc644" returned: 0 in 0.301s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:50:16 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:50:16 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68049df3-2936-45ee-8701-03f8dca9444a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3d61d37-055d-4bac-8ea4-091af2ffc644', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f378df-cf64-4ac4-858a-ce235fa39147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:16 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Volume volume-c3d61d37-055d-4bac-8ea4-091af2ffc644 (c3d61d37-055d-4bac-8ea4-091af2ffc644): created successfully Nov 06 10:50:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f378df-cf64-4ac4-858a-ce235fa39147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Flow 'volume_create_manager' (01f585a8-2e2e-4176-be85-8f42471d1590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:16 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b80e88f1-31fa-4cda-a2bd-07b34443efe5 tempest-VolumesListAdminTestJSON-1103977354 None] Created volume successfully. Nov 06 10:50:16 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-382c69d5-00e3-4096-bd1c-21dc367eecd5 tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.260s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:16 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-382c69d5-00e3-4096-bd1c-21dc367eecd5 tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:50:16 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-382c69d5-00e3-4096-bd1c-21dc367eecd5 tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Retype volume completed successfully. Nov 06 10:50:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Acquiring lock "cinder-a0ea9b10-b7b1-463d-9147-2702161e234f-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Lock "cinder-a0ea9b10-b7b1-463d-9147-2702161e234f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Acquiring lock "cinder-quobyte-a0ea9b10-b7b1-463d-9147-2702161e234f" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Lock "cinder-quobyte-a0ea9b10-b7b1-463d-9147-2702161e234f" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:17 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f5a4f4-51ac-424a-9df7-6e447b95a114]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a0ea9b10-b7b1-463d-9147-2702161e234f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:17 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a0ea9b10-b7b1-463d-9147-2702161e234f Nov 06 10:50:17 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:17 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:50:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Flow 'volume_create_manager' (20bda30a-ac3c-4bce-999c-f65e143046e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4438fa-1d40-4752-b6f7-2acd15fd1ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4438fa-1d40-4752-b6f7-2acd15fd1ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1500589993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4627a6aa-eb20-47c7-bd93-f377e31ab0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2fe7bb21f14543a0e0da1620a4a730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:18Z,use_quota=True,user_id='6aa66c0bc61148efbda7c617b2000ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de868bd-8455-4682-881f-21854f634492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de868bd-8455-4682-881f-21854f634492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cc5027-86ce-499b-b037-7bc4fb4f2fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cc5027-86ce-499b-b037-7bc4fb4f2fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4627a6aa-eb20-47c7-bd93-f377e31ab0c5', 'volume_name': 'volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339d4036-25dc-4609-a970-09285ec51576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339d4036-25dc-4609-a970-09285ec51576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1305d049-83b1-4210-be02-d7fa2060f677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:18 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Volume 4627a6aa-eb20-47c7-bd93-f377e31ab0c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5', 'volume_size': 1} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1500589993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4627a6aa-eb20-47c7-bd93-f377e31ab0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2fe7bb21f14543a0e0da1620a4a730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:18Z,use_quota=True,user_id='6aa66c0bc61148efbda7c617b2000ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Creating volume 4627a6aa-eb20-47c7-bd93-f377e31ab0c5 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:50:18 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:18 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a0ea9b10-b7b1-463d-9147-2702161e234f" returned: 0 in 0.824s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a0ea9b10-b7b1-463d-9147-2702161e234f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:18 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5 1073741824 Nov 06 10:50:18 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:18 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a0ea9b10-b7b1-463d-9147-2702161e234f Nov 06 10:50:18 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:18 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a0ea9b10-b7b1-463d-9147-2702161e234f" returned: 0 in 0.410s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Lock "cinder-quobyte-a0ea9b10-b7b1-463d-9147-2702161e234f" released by "delete_volume" :: held 1.293s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:18 devstack cinder-volume[86819]: WARNING cinder.quota [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:50:18 devstack cinder-volume[86819]: WARNING cinder.quota [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Created reservations ['a5ef73ef-8712-431e-8965-8ecb8efc00ca', '39db9283-00fd-4d01-ab4c-666637a48515', 'ae5ea383-2b78-4c09-94ec-02c66f378376', '36c547a8-c7fc-4533-9700-0cc16b80fa6b'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:18 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5 1073741824" returned: 0 in 0.668s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:18 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:50:18 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:18 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5 Nov 06 10:50:18 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:19 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.265s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:19 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:50:19 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Deleted volume successfully. Nov 06 10:50:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1366cfa9-40e0-41e7-ba58-439a55c4ee9f tempest-VolumeRetypeWithoutMigrationTest-1682958219 None] Lock "cinder-a0ea9b10-b7b1-463d-9147-2702161e234f-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:19 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5" returned: 0 in 0.263s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:19 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:50:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1305d049-83b1-4210-be02-d7fa2060f677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87dc9386-0f3a-4fd1-b9e3-d800d1fd1d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:19 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Volume volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5 (4627a6aa-eb20-47c7-bd93-f377e31ab0c5): created successfully Nov 06 10:50:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87dc9386-0f3a-4fd1-b9e3-d800d1fd1d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Flow 'volume_create_manager' (20bda30a-ac3c-4bce-999c-f65e143046e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:19 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-edcb92e6-278b-4b86-9ac5-82e773b46f19 tempest-VolumesListAdminTestJSON-1103977354 None] Created volume successfully. Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Flow 'volume_create_manager' (02128b10-d2bb-4b2b-bea3-fb2dd11d3a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a460b9-d0ae-47da-9ce3-db030401fb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a460b9-d0ae-47da-9ce3-db030401fb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1714498829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2fe7bb21f14543a0e0da1620a4a730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:20Z,use_quota=True,user_id='6aa66c0bc61148efbda7c617b2000ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4def61e8-4815-4722-a1fd-29f6a1aaef2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4def61e8-4815-4722-a1fd-29f6a1aaef2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d61ce6e-81dd-4143-b6aa-40909e18d033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d61ce6e-81dd-4143-b6aa-40909e18d033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378', 'volume_name': 'volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4dd5f1-ba9a-4466-b65f-c625398a2a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4dd5f1-ba9a-4466-b65f-c625398a2a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f62776-085b-49a4-bef3-a6d733eb5f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:20 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Volume f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378', 'volume_size': 1} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1714498829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2fe7bb21f14543a0e0da1620a4a730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:20Z,use_quota=True,user_id='6aa66c0bc61148efbda7c617b2000ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Creating volume f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:50:20 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:50:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:20 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378 1073741824 Nov 06 10:50:20 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:21 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378 1073741824" returned: 0 in 0.678s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:21 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378 Nov 06 10:50:21 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:21 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378" returned: 0 in 0.314s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:50:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f62776-085b-49a4-bef3-a6d733eb5f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5532fea7-4aea-452b-ba90-1843f520cce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:21 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Volume volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378 (f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378): created successfully Nov 06 10:50:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5532fea7-4aea-452b-ba90-1843f520cce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Flow 'volume_create_manager' (02128b10-d2bb-4b2b-bea3-fb2dd11d3a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:21 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b1eee273-dc3d-4fa6-a882-fb42af95be7e tempest-VolumesListAdminTestJSON-1103977354 None] Created volume successfully. Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Flow 'volume_create_manager' (e674c20e-6be7-46e0-baef-9a5f61633217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8fd799d-7ebb-4995-a0e6-95f0c44fc3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8fd799d-7ebb-4995-a0e6-95f0c44fc3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4de721-eac6-44b3-a909-be5f80b107c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a172a679bb4662942b1ecfcefa7a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:24Z,use_quota=True,user_id='9d3dbd1cb6fd44c1aad283a02489b9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad50c7fa-53e6-4126-8060-654b36231f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad50c7fa-53e6-4126-8060-654b36231f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0ceaf8-b63e-4942-9ad0-a8c550ac31c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0ceaf8-b63e-4942-9ad0-a8c550ac31c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e4de721-eac6-44b3-a909-be5f80b107c9', 'volume_name': 'volume-6e4de721-eac6-44b3-a909-be5f80b107c9', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd913804-7b7b-4219-be6c-40e3f5c770f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd913804-7b7b-4219-be6c-40e3f5c770f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd4c74f-78c0-4bd4-ba8c-4158d40aee70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:24 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Volume 6e4de721-eac6-44b3-a909-be5f80b107c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e4de721-eac6-44b3-a909-be5f80b107c9', 'volume_size': 1} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4de721-eac6-44b3-a909-be5f80b107c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a172a679bb4662942b1ecfcefa7a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:24Z,use_quota=True,user_id='9d3dbd1cb6fd44c1aad283a02489b9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Creating volume 6e4de721-eac6-44b3-a909-be5f80b107c9 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:50:24 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:50:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6e4de721-eac6-44b3-a909-be5f80b107c9 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:24 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6e4de721-eac6-44b3-a909-be5f80b107c9 1073741824 Nov 06 10:50:24 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:25 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6e4de721-eac6-44b3-a909-be5f80b107c9 1073741824" returned: 0 in 0.974s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6e4de721-eac6-44b3-a909-be5f80b107c9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:25 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6e4de721-eac6-44b3-a909-be5f80b107c9 Nov 06 10:50:25 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:25 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6e4de721-eac6-44b3-a909-be5f80b107c9" returned: 0 in 0.384s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:50:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd4c74f-78c0-4bd4-ba8c-4158d40aee70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e4de721-eac6-44b3-a909-be5f80b107c9', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e73a0b-7dd6-427a-968c-1a80cd5be57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:25 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Volume volume-6e4de721-eac6-44b3-a909-be5f80b107c9 (6e4de721-eac6-44b3-a909-be5f80b107c9): created successfully Nov 06 10:50:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e73a0b-7dd6-427a-968c-1a80cd5be57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Flow 'volume_create_manager' (e674c20e-6be7-46e0-baef-9a5f61633217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:25 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-78cf4b43-84db-4a99-b9b4-e7d63462365b tempest-VolumesListAdminTestJSON-1835252521 None] Created volume successfully. Nov 06 10:50:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Acquiring lock "cinder-6e4de721-eac6-44b3-a909-be5f80b107c9-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Lock "cinder-6e4de721-eac6-44b3-a909-be5f80b107c9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Acquiring lock "cinder-quobyte-6e4de721-eac6-44b3-a909-be5f80b107c9" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Lock "cinder-quobyte-6e4de721-eac6-44b3-a909-be5f80b107c9" acquired by "delete_volume" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:26 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd200184-82ce-42d4-9275-142255a9e71d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6e4de721-eac6-44b3-a909-be5f80b107c9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Acquiring lock "cinder-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Lock "cinder-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Acquiring lock "cinder-quobyte-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Lock "cinder-quobyte-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:26 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6e4de721-eac6-44b3-a909-be5f80b107c9 Nov 06 10:50:26 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:26 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa331f0-33cc-4937-af35-352e032f8934]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:27 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378 Nov 06 10:50:27 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:27 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6e4de721-eac6-44b3-a909-be5f80b107c9" returned: 0 in 0.665s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6e4de721-eac6-44b3-a909-be5f80b107c9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:27 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6e4de721-eac6-44b3-a909-be5f80b107c9 Nov 06 10:50:27 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:27 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378" returned: 0 in 0.571s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:27 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378 Nov 06 10:50:27 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:27 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378" returned: 0 in 0.453s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:27 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6e4de721-eac6-44b3-a909-be5f80b107c9" returned: 0 in 0.609s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Lock "cinder-quobyte-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378" released by "delete_volume" :: held 1.130s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Lock "cinder-quobyte-6e4de721-eac6-44b3-a909-be5f80b107c9" released by "delete_volume" :: held 1.387s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Created reservations ['621260d0-7371-46bc-96c2-adf6e8d8cda2', '8e9e1ed8-acce-475f-b57b-952baff11e99', '7df61d5a-679d-4e4b-a982-9042617d5259', '3296b062-0959-4691-a4fe-6bf867e59a56'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Created reservations ['058c374d-ff9b-425c-a58f-6ddd3d038fb7', 'a6b73647-7475-4716-bb29-febe84e518fd', 'feb74bfd-8132-4654-829d-90f31d23e28b', '934ccc98-f3b5-44d7-893d-152a727de987'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:28 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:50:28 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:28 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:50:28 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:28 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.313s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:50:28 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Deleted volume successfully. Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-288d482b-17b1-4ad3-a8bd-7fb8ba9ac88b tempest-VolumesListAdminTestJSON-1835252521 None] Lock "cinder-6e4de721-eac6-44b3-a909-be5f80b107c9-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:28 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.505s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:50:28 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Deleted volume successfully. Nov 06 10:50:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2fe65938-9558-4542-86b9-8fbf4c60979f tempest-VolumesListAdminTestJSON-1103977354 None] Lock "cinder-f1bf8e3c-afc9-48b2-9500-6c5c4c2f3378-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Acquiring lock "cinder-4627a6aa-eb20-47c7-bd93-f377e31ab0c5-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Lock "cinder-4627a6aa-eb20-47c7-bd93-f377e31ab0c5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Acquiring lock "cinder-quobyte-4627a6aa-eb20-47c7-bd93-f377e31ab0c5" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Lock "cinder-quobyte-4627a6aa-eb20-47c7-bd93-f377e31ab0c5" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9ab1a6-fd67-4aba-a88e-b1666ace34c3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:29 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5 Nov 06 10:50:29 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:29 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5" returned: 0 in 0.573s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:50:29 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5 Nov 06 10:50:29 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Flow 'volume_create_manager' (54bc83f6-4383-4763-b2a8-e30ea9b6fc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ec75cc-d6ef-475d-bd73-a6d984bfbd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ec75cc-d6ef-475d-bd73-a6d984bfbd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-110937705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c2c54c-632d-4ca4-83b6-a2aff564c55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d184a0d1f0f4a7a81748d6ecf3807fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:30Z,use_quota=True,user_id='ad5e857506ee42859ad2a1c6e699148d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8315f6d-a679-4c16-9ccb-99aae41d63b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8315f6d-a679-4c16-9ccb-99aae41d63b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4efd04-2491-4e91-8b12-17d72eedc60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4efd04-2491-4e91-8b12-17d72eedc60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10c2c54c-632d-4ca4-83b6-a2aff564c55d', 'volume_name': 'volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e211334-9ac8-4640-a99e-8dce3d6571d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e211334-9ac8-4640-a99e-8dce3d6571d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00999be5-6dfd-4438-b61b-c5858113d4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:29 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Volume 10c2c54c-632d-4ca4-83b6-a2aff564c55d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d', 'volume_size': 1} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-110937705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c2c54c-632d-4ca4-83b6-a2aff564c55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d184a0d1f0f4a7a81748d6ecf3807fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:30Z,use_quota=True,user_id='ad5e857506ee42859ad2a1c6e699148d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Creating volume 10c2c54c-632d-4ca4-83b6-a2aff564c55d {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:50:30 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:30 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d 1073741824 Nov 06 10:50:30 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:30 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4627a6aa-eb20-47c7-bd93-f377e31ab0c5" returned: 0 in 0.337s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Lock "cinder-quobyte-4627a6aa-eb20-47c7-bd93-f377e31ab0c5" released by "delete_volume" :: held 0.968s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Created reservations ['5304597d-5b71-4d7c-8000-9c6b8b4172e4', 'ea150cb4-4638-459a-9b14-e41edd15c055', '13cdc8f2-d4b9-42dd-adce-e69a56df60cb', '68f6f86c-af58-4494-bf4c-bb90065413ff'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:30 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:50:30 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:30 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d 1073741824" returned: 0 in 0.582s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:30 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d Nov 06 10:50:30 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:30 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.395s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:50:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Deleted volume successfully. Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-000b162e-dc73-424e-a159-211174a884ca tempest-VolumesListAdminTestJSON-1103977354 None] Lock "cinder-4627a6aa-eb20-47c7-bd93-f377e31ab0c5-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:30 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d" returned: 0 in 0.347s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00999be5-6dfd-4438-b61b-c5858113d4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b490226b-7fea-42ed-bdb7-3c44ec6b8a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:31 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Volume volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d (10c2c54c-632d-4ca4-83b6-a2aff564c55d): created successfully Nov 06 10:50:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b490226b-7fea-42ed-bdb7-3c44ec6b8a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Flow 'volume_create_manager' (54bc83f6-4383-4763-b2a8-e30ea9b6fc72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:31 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-71a8f318-cf90-4ac8-a3a2-e4cc3d170a9b tempest-VolumesServicesTestJSON-567087754 None] Created volume successfully. Nov 06 10:50:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Acquiring lock "cinder-c3d61d37-055d-4bac-8ea4-091af2ffc644-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Lock "cinder-c3d61d37-055d-4bac-8ea4-091af2ffc644-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Acquiring lock "cinder-quobyte-c3d61d37-055d-4bac-8ea4-091af2ffc644" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Lock "cinder-quobyte-c3d61d37-055d-4bac-8ea4-091af2ffc644" acquired by "delete_volume" :: waited 0.027s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:31 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[233f615b-fc97-4f6e-8f32-681e3dc7141f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3d61d37-055d-4bac-8ea4-091af2ffc644 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:31 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3d61d37-055d-4bac-8ea4-091af2ffc644 Nov 06 10:50:31 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:32 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3d61d37-055d-4bac-8ea4-091af2ffc644" returned: 0 in 0.427s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3d61d37-055d-4bac-8ea4-091af2ffc644 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:32 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3d61d37-055d-4bac-8ea4-091af2ffc644 Nov 06 10:50:32 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Acquiring lock "cinder-10c2c54c-632d-4ca4-83b6-a2aff564c55d-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Lock "cinder-10c2c54c-632d-4ca4-83b6-a2aff564c55d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Acquiring lock "cinder-quobyte-10c2c54c-632d-4ca4-83b6-a2aff564c55d" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Lock "cinder-quobyte-10c2c54c-632d-4ca4-83b6-a2aff564c55d" acquired by "delete_volume" :: waited 0.032s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[58155237-8bf8-402c-a992-813d281bffe8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:32 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c3d61d37-055d-4bac-8ea4-091af2ffc644" returned: 0 in 0.654s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:32 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d Nov 06 10:50:32 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Lock "cinder-quobyte-c3d61d37-055d-4bac-8ea4-091af2ffc644" released by "delete_volume" :: held 1.142s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Created reservations ['b6278cea-9e0f-464e-85c9-bbfffcf937c0', '442b4530-3855-4bb8-9126-cf7e90769c6c', '514efde3-9856-4bac-afb9-af6eaf095404', '607813df-26a9-4f6e-90ab-cc21887cf297'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:32 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:50:32 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:33 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d" returned: 0 in 0.791s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:33 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d Nov 06 10:50:33 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:33 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.341s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:33 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:50:33 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Deleted volume successfully. Nov 06 10:50:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cbccb1bd-cd20-4842-a3b3-2ba7385bfd81 tempest-VolumesListAdminTestJSON-1103977354 None] Lock "cinder-c3d61d37-055d-4bac-8ea4-091af2ffc644-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:33 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c2c54c-632d-4ca4-83b6-a2aff564c55d" returned: 0 in 0.328s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Lock "cinder-quobyte-10c2c54c-632d-4ca4-83b6-a2aff564c55d" released by "delete_volume" :: held 1.226s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:33 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Created reservations ['9bdd8c5d-59bc-42aa-92cf-9ec10689dff4', 'b65e66eb-ff80-4109-bbb2-475e68769ecf', '3e1b1538-a144-4af8-a8b8-d492f2268503', '52358c05-2cc5-400e-a9fe-21583c57c36e'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:50:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:33 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:50:33 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:34 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.321s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:34 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:50:34 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Deleted volume successfully. Nov 06 10:50:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b111dbbc-eec8-43b4-b1ff-4ca2bd5a8c9c tempest-VolumesServicesTestJSON-567087754 None] Lock "cinder-10c2c54c-632d-4ca4-83b6-a2aff564c55d-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:50:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:36 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:50:36 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:36 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.281s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:50:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:50:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 29 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:50:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:50:42 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:50:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Flow 'volume_create_manager' (74a47d52-c3d0-4a9e-8b50-eca79acc974b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc6c7a8-9774-4124-ab47-ea2fb6b6721d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc6c7a8-9774-4124-ab47-ea2fb6b6721d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2035483254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8edc456-1edf-4aa8-b7a8-097463213270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2492a86a68ed42cbb694b33c957bc15c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:42Z,use_quota=True,user_id='058bf4f16b174e49aa7a5b7a49145116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24cb51e-f7bb-493f-84ec-1166047bd545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24cb51e-f7bb-493f-84ec-1166047bd545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfa168d-6d84-4b43-8a9d-ef7c8ae0562a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:42 devstack cinder-volume[86819]: DEBUG cinder.image.glance [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Creating Keystone auth plugin from conf {{(pid=86819) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 10:50:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfa168d-6d84-4b43-8a9d-ef7c8ae0562a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8edc456-1edf-4aa8-b7a8-097463213270', 'volume_name': 'volume-a8edc456-1edf-4aa8-b7a8-097463213270', 'volume_size': 1, 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a31bb778f245ada373212e6fd01b04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'created_at': datetime.datetime(2026, 11, 6, 9, 33, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3141da4f-e70d-439b-81af-e22387bd01d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57eb1e0f-4efa-4483-8caa-1dcc51e31976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57eb1e0f-4efa-4483-8caa-1dcc51e31976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6db1e4-5f9c-40ce-8e59-d4cf7a4bdaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:43 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Volume a8edc456-1edf-4aa8-b7a8-097463213270: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8edc456-1edf-4aa8-b7a8-097463213270', 'volume_size': 1, 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a31bb778f245ada373212e6fd01b04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'created_at': datetime.datetime(2026, 11, 6, 9, 33, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3141da4f-e70d-439b-81af-e22387bd01d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 10:50:43 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Trying to clone a8edc456-1edf-4aa8-b7a8-097463213270 from image 3141da4f-e70d-439b-81af-e22387bd01d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]). {{(pid=86819) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 10:50:43 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_zmv4us9bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 10:50:43 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Image download 20.69 MB at 20.69 MB/s Nov 06 10:50:43 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[70636139-8ff2-486c-b8f0-96432d831b05]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_zmv4us9bdevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:43 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_zmv4us9bdevstack@QuobyteHD Nov 06 10:50:43 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:43 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_zmv4us9bdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Temporary image 3141da4f-e70d-439b-81af-e22387bd01d4 is fetched for user 058bf4f16b174e49aa7a5b7a49145116. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca281c1-6388-4343-9beb-d420c3b2039e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_zmv4us9bdevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:44 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_zmv4us9bdevstack@QuobyteHD Nov 06 10:50:44 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:44 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_zmv4us9bdevstack@QuobyteHD" returned: 0 in 0.560s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2035483254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8edc456-1edf-4aa8-b7a8-097463213270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2492a86a68ed42cbb694b33c957bc15c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:42Z,use_quota=True,user_id='058bf4f16b174e49aa7a5b7a49145116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Creating volume a8edc456-1edf-4aa8-b7a8-097463213270 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:50:44 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:50:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:44 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270 1073741824 Nov 06 10:50:44 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:45 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270 1073741824" returned: 0 in 0.685s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:45 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270 Nov 06 10:50:45 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:45 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270" returned: 0 in 0.340s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Attempting download of 3141da4f-e70d-439b-81af-e22387bd01d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}])) to volume a8edc456-1edf-4aa8-b7a8-097463213270. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Flow 'volume_create_manager' (181b80f8-9d3d-4308-a948-41f22fdafb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0691e1-e643-4503-8a13-37521ddcab2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[99715ab6-b8fd-4526-b6af-f590b6281e0e]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_ytb9sjdd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0691e1-e643-4503-8a13-37521ddcab2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-900697973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5dda525-d391-483f-9a1f-5c0ff0164a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e7a3e53c54459a8f55c03386004d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:46Z,use_quota=True,user_id='e290b867bf634dcda453250d67fa979f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d311e9-a9f1-4268-89a5-b2ca3b821cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d311e9-a9f1-4268-89a5-b2ca3b821cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d3fc80-41f0-485a-b240-a56213b3b832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d3fc80-41f0-485a-b240-a56213b3b832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5dda525-d391-483f-9a1f-5c0ff0164a1e', 'volume_name': 'volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6bc2e45-68c6-4b61-b4d5-99875006dfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6bc2e45-68c6-4b61-b4d5-99875006dfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9743a683-975c-4fd6-ade5-63bfe9e3e1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:46 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Volume c5dda525-d391-483f-9a1f-5c0ff0164a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e', 'volume_size': 1} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-900697973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5dda525-d391-483f-9a1f-5c0ff0164a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e7a3e53c54459a8f55c03386004d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:50:46Z,use_quota=True,user_id='e290b867bf634dcda453250d67fa979f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Creating volume c5dda525-d391-483f-9a1f-5c0ff0164a1e {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:50:46 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:46 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e 1073741824 Nov 06 10:50:46 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:46 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_ytb9sjdd Nov 06 10:50:46 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:46 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_ytb9sjdd" returned: 0 in 0.575s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_ytb9sjdd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:46 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_ytb9sjdd Nov 06 10:50:46 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:46 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e 1073741824" returned: 0 in 0.654s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:46 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e Nov 06 10:50:46 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:46 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_ytb9sjdd" returned: 1 in 0.424s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_ytb9sjdd' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[743b835f-8810-4375-a401-5e6ea1232f20]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_zmv4us9bdevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:47 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_zmv4us9bdevstack@QuobyteHD Nov 06 10:50:47 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:47 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e" returned: 0 in 0.348s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:50:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9743a683-975c-4fd6-ade5-63bfe9e3e1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e35ed95-4364-4656-89f2-f38f4e3274a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:47 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Volume volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e (c5dda525-d391-483f-9a1f-5c0ff0164a1e): created successfully Nov 06 10:50:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e35ed95-4364-4656-89f2-f38f4e3274a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Flow 'volume_create_manager' (181b80f8-9d3d-4308-a948-41f22fdafb8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:47 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b867e46c-b706-4bee-bb08-459e78d589dd tempest-VolumesDeleteCascade-531229256 None] Created volume successfully. Nov 06 10:50:47 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_zmv4us9bdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:47 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] 3141da4f-e70d-439b-81af-e22387bd01d4 was qcow2, converting to qcow2 {{(pid=86819) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 10:50:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_zmv4us9bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:47 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_zmv4us9bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270 Nov 06 10:50:47 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] Creating offline snapshot b378a2c4-6fa5-4e47-a962-61c83dc07aaa of volume c5dda525-d391-483f-9a1f-5c0ff0164a1e {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:50:48 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4402e8d-da8f-4b51-9193-584ceb778eeb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:48 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e Nov 06 10:50:48 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:49 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e" returned: 0 in 0.797s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:49 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa 1G Nov 06 10:50:49 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:50 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-3760d1e2-e9f2-47ea-9cb2-310e820bbdc7 req-6ceb4262-c3dd-420c-91e7-606b3b0e5760 tempest-TestMinimumBasicScenario-192056331 None] Terminate volume connection completed successfully. Nov 06 10:50:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-3760d1e2-e9f2-47ea-9cb2-310e820bbdc7 req-6ceb4262-c3dd-420c-91e7-606b3b0e5760 tempest-TestMinimumBasicScenario-192056331 None] Deleting attachment d443f436-0d3f-4b58-a1d8-ab6685470ed2. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:50:50 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa 1G" returned: 0 in 1.179s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:50 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa Nov 06 10:50:50 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:50 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_zmv4us9bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270" returned: 0 in 3.365s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:50 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_zmv4us9bdevstack@QuobyteHD, size 112.00 MB, duration 3.37 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270 {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:50:50 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Converted 112.00 MB image at 33.27 MB/s Nov 06 10:50:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:50 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270 1G Nov 06 10:50:50 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:50 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa" returned: 0 in 0.730s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:51 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa is being set with open permissions: ugo+rw Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:51 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa Nov 06 10:50:51 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:51 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270 1G" returned: 0 in 0.557s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Downloaded image 3141da4f-e70d-439b-81af-e22387bd01d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}])) to volume a8edc456-1edf-4aa8-b7a8-097463213270 successfully. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Temporary image 3141da4f-e70d-439b-81af-e22387bd01d4 for user 058bf4f16b174e49aa7a5b7a49145116 is deleted. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Marking volume a8edc456-1edf-4aa8-b7a8-097463213270 as bootable. {{(pid=86819) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Copying metadata from image 3141da4f-e70d-439b-81af-e22387bd01d4 to a8edc456-1edf-4aa8-b7a8-097463213270. {{(pid=86819) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Creating volume glance metadata for volume a8edc456-1edf-4aa8-b7a8-097463213270 backed by image 3141da4f-e70d-439b-81af-e22387bd01d4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86819) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6db1e4-5f9c-40ce-8e59-d4cf7a4bdaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8edc456-1edf-4aa8-b7a8-097463213270', 'volume_size': 1, 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a31bb778f245ada373212e6fd01b04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'created_at': datetime.datetime(2026, 11, 6, 9, 33, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3141da4f-e70d-439b-81af-e22387bd01d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3826bf9c-c746-4a42-8361-5f76335fb303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:50:51 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Volume volume-a8edc456-1edf-4aa8-b7a8-097463213270 (a8edc456-1edf-4aa8-b7a8-097463213270): created successfully Nov 06 10:50:51 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3826bf9c-c746-4a42-8361-5f76335fb303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Flow 'volume_create_manager' (74a47d52-c3d0-4a9e-8b50-eca79acc974b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa" returned: 0 in 0.507s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:51 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-efd1301b-8e1f-457d-af33-1f531e99d7c2 tempest-VolumesImageMetadata-1596711099 None] Created volume successfully. Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:51 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.info Nov 06 10:50:51 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:51 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.info" returned: 0 in 0.289s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:51 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.info is being set with open permissions: ugo+rw Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Acquiring lock "cinder-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Lock "cinder-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:51 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.info Nov 06 10:50:51 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Acquiring lock "cinder-quobyte-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Lock "cinder-quobyte-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0" acquired by "delete_volume" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:52 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d31726-d658-4a5d-9bba-7bf8f19ec751]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:52 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0 Nov 06 10:50:52 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:52 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.info" returned: 0 in 0.336s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.956s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:52 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ce5f3e31-522c-4fe4-909f-824eac502e4c tempest-VolumesDeleteCascade-531229256 None] Create snapshot completed successfully Nov 06 10:50:52 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0" returned: 0 in 0.411s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:52 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0 Nov 06 10:50:52 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:52 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0" returned: 0 in 0.359s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Lock "cinder-quobyte-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0" released by "delete_volume" :: held 0.838s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-89a29cdb-0f7e-42c6-875b-06bd0c98f342 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-89a29cdb-0f7e-42c6-875b-06bd0c98f342 tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:52 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Created reservations ['bbfb9583-42e0-4376-b104-85680c2bf982', 'f692fbee-ce80-4cfa-b6ee-6b4e45006354', 'c78c2bd1-d09d-4ddc-b36a-b3a6e7e58f22', 'ace7464a-c1af-4b6e-8447-3e3f38d56242'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:50:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-89a29cdb-0f7e-42c6-875b-06bd0c98f342 tempest-VolumesDeleteCascade-531229256 None] Creating offline snapshot d87b4711-044a-4c9b-aee2-1b891c0aabb5 of volume c5dda525-d391-483f-9a1f-5c0ff0164a1e {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcb9df5-b893-48bd-80aa-3db4f5a9f230]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-89a29cdb-0f7e-42c6-875b-06bd0c98f342 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:53 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:50:53 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:53 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa Nov 06 10:50:53 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:53 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.321s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Acquiring lock "cinder-a8edc456-1edf-4aa8-b7a8-097463213270-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:53 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Deleted volume successfully. Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8cac8831-4ec3-4309-badc-3be5df6b31af tempest-TestMinimumBasicScenario-192056331 None] Lock "cinder-d3bbe0b7-7cd5-4a0f-abdc-58bdd2f3e9c0-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Lock "cinder-a8edc456-1edf-4aa8-b7a8-097463213270-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:53 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-89a29cdb-0f7e-42c6-875b-06bd0c98f342 tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa" returned: 0 in 0.614s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-89a29cdb-0f7e-42c6-875b-06bd0c98f342 tempest-VolumesDeleteCascade-531229256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-89a29cdb-0f7e-42c6-875b-06bd0c98f342 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Acquiring lock "cinder-quobyte-a8edc456-1edf-4aa8-b7a8-097463213270" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:53 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 1G Nov 06 10:50:53 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Lock "cinder-quobyte-a8edc456-1edf-4aa8-b7a8-097463213270" acquired by "delete_volume" :: waited 0.028s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30d549c-59e4-4318-901e-f94bfb414d92]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:53 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270 Nov 06 10:50:53 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:54 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270" returned: 0 in 0.544s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:54 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270 Nov 06 10:50:54 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:54 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-89a29cdb-0f7e-42c6-875b-06bd0c98f342 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 1G" returned: 0 in 0.730s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-89a29cdb-0f7e-42c6-875b-06bd0c98f342 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:54 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 Nov 06 10:50:54 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:54 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a8edc456-1edf-4aa8-b7a8-097463213270" returned: 0 in 0.439s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Lock "cinder-quobyte-a8edc456-1edf-4aa8-b7a8-097463213270" released by "delete_volume" :: held 1.075s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:54 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Created reservations ['23e108ac-f068-4d7e-9f23-5b9e11ad2d8b', '44278546-05a0-4fbd-bf20-d0f436ac7f54', 'ec13be2e-f9e6-4014-bf6a-69189813487d', 'b89391ba-0227-4f5f-b0eb-06ae5468791a'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:50:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:50:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:50:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:50:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:50:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:55 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:50:55 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:55 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-89a29cdb-0f7e-42c6-875b-06bd0c98f342 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5" returned: 0 in 0.931s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:55 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-89a29cdb-0f7e-42c6-875b-06bd0c98f342 tempest-VolumesDeleteCascade-531229256 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 is being set with open permissions: ugo+rw Nov 06 10:50:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-89a29cdb-0f7e-42c6-875b-06bd0c98f342 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:55 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 Nov 06 10:50:55 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:55 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.454s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:55 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:50:55 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Deleted volume successfully. Nov 06 10:50:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0f7e7884-477d-4311-ba30-20a48aa4827c tempest-VolumesImageMetadata-1596711099 None] Lock "cinder-a8edc456-1edf-4aa8-b7a8-097463213270-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:50:55 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-89a29cdb-0f7e-42c6-875b-06bd0c98f342 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5" returned: 0 in 0.557s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-89a29cdb-0f7e-42c6-875b-06bd0c98f342 tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.063s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:50:56 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-89a29cdb-0f7e-42c6-875b-06bd0c98f342 tempest-VolumesDeleteCascade-531229256 None] Create snapshot completed successfully Nov 06 10:50:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-c5dda525-d391-483f-9a1f-5c0ff0164a1e-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-c5dda525-d391-483f-9a1f-5c0ff0164a1e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Performing cascade delete. {{(pid=86819) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 10:50:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-b378a2c4-6fa5-4e47-a962-61c83dc07aaa-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-b378a2c4-6fa5-4e47-a962-61c83dc07aaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-quobyte-c5dda525-d391-483f-9a1f-5c0ff0164a1e" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-c5dda525-d391-483f-9a1f-5c0ff0164a1e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-quobyte-b378a2c4-6fa5-4e47-a962-61c83dc07aaa" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:50:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-b378a2c4-6fa5-4e47-a962-61c83dc07aaa" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:50:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Deleting offline snapshot b378a2c4-6fa5-4e47-a962-61c83dc07aaa of volume c5dda525-d391-483f-9a1f-5c0ff0164a1e {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:50:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] snapshot_file for this snap is: volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:50:56 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c2da8c-2255-45d5-98e9-373bcf682a63]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:56 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa Nov 06 10:50:56 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:57 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa" returned: 0 in 0.717s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:50:57 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[83313174-7db7-4db0-b05a-d3daf05a5514]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:57 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e Nov 06 10:50:57 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:57 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e" returned: 0 in 0.490s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:57 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[31142190-4537-48b8-a0a7-ee9e222268ce]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:58 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 Nov 06 10:50:58 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:58 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5" returned: 0 in 0.522s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:50:58 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa63c3b7-20a1-4dac-b2c7-c4e0d59c6de4]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:58 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa Nov 06 10:50:58 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:59 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa" returned: 0 in 0.483s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:50:59 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[168dd0f0-2a78-4362-a919-b76d63b0f3a1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:50:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:59 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e Nov 06 10:50:59 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:50:59 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Nov 06 10:50:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e" returned: 0 in 0.578s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:50:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:50:59 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa Nov 06 10:50:59 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:00 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa" returned: 0 in 0.444s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:00 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa Nov 06 10:51:00 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:00 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.b378a2c4-6fa5-4e47-a962-61c83dc07aaa" returned: 0 in 0.397s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 -F qcow2 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:00 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 -F qcow2 Nov 06 10:51:00 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:00 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 -F qcow2" returned: 0 in 0.343s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-b378a2c4-6fa5-4e47-a962-61c83dc07aaa" released by "_delete_snapshot" :: held 4.256s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-c5dda525-d391-483f-9a1f-5c0ff0164a1e" released by "delete_snapshot" :: held 4.329s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:00 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Created reservations ['a2890e63-516b-489f-b42a-3bd0be29f516', 'f8e9190f-c874-4e12-95e9-1f7e2a8f69ef', 'ec59a7d0-8eeb-48b9-9504-7d8a611c58e3', 'e76b6310-447d-4629-9994-54c6e0abcb0a'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:01 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Delete snapshot completed successfully. Nov 06 10:51:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-b378a2c4-6fa5-4e47-a962-61c83dc07aaa-delete_snapshot" released by "delete_snapshot" :: held 4.562s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-d87b4711-044a-4c9b-aee2-1b891c0aabb5-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-d87b4711-044a-4c9b-aee2-1b891c0aabb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-quobyte-c5dda525-d391-483f-9a1f-5c0ff0164a1e" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-c5dda525-d391-483f-9a1f-5c0ff0164a1e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-quobyte-d87b4711-044a-4c9b-aee2-1b891c0aabb5" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-d87b4711-044a-4c9b-aee2-1b891c0aabb5" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Deleting offline snapshot d87b4711-044a-4c9b-aee2-1b891c0aabb5 of volume c5dda525-d391-483f-9a1f-5c0ff0164a1e {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:51:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] snapshot_file for this snap is: volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:51:01 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4aa10ee-4d40-4281-b838-344eb24dc089]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:01 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 Nov 06 10:51:01 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:01 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5" returned: 0 in 0.694s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:51:01 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1510d50-6a11-4274-b414-1833dd26106d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:02 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e Nov 06 10:51:02 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Flow 'volume_create_manager' (27bf2f7c-7658-4325-9e99-5d4a5e237beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200ed574-8404-40fc-bab5-1d334769132c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200ed574-8404-40fc-bab5-1d334769132c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-343275169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6660172c-82b1-4690-94f6-4e882d9df5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bcc8cae152547cda1e7d627a64c9d51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:02Z,use_quota=True,user_id='30d193137321402d81fc099ebdd249c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75520627-bf68-4e25-976d-9a22240e260f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75520627-bf68-4e25-976d-9a22240e260f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186979d1-48ac-4c5c-b168-5c5993022502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186979d1-48ac-4c5c-b168-5c5993022502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6660172c-82b1-4690-94f6-4e882d9df5a6', 'volume_name': 'volume-6660172c-82b1-4690-94f6-4e882d9df5a6', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48694cfa-554a-4485-ad2f-ec64ec2b1ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48694cfa-554a-4485-ad2f-ec64ec2b1ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4171d588-feac-41a3-bf35-701da2a2aa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:02 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Volume 6660172c-82b1-4690-94f6-4e882d9df5a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6660172c-82b1-4690-94f6-4e882d9df5a6', 'volume_size': 1} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-343275169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6660172c-82b1-4690-94f6-4e882d9df5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bcc8cae152547cda1e7d627a64c9d51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:02Z,use_quota=True,user_id='30d193137321402d81fc099ebdd249c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Creating volume 6660172c-82b1-4690-94f6-4e882d9df5a6 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:02 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:02 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6 1073741824 Nov 06 10:51:02 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:02 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e" returned: 0 in 0.420s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:02 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 Nov 06 10:51:02 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:02 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5" returned: 0 in 0.364s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:02 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6 1073741824" returned: 0 in 0.479s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:02 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5 Nov 06 10:51:02 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=86,cinder:UPDATE=100,cinder:DELETE=12,cinder:INSERT=26 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:51:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:02 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6 Nov 06 10:51:02 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:03 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e.d87b4711-044a-4c9b-aee2-1b891c0aabb5" returned: 0 in 0.352s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:03 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6" returned: 0 in 0.318s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-d87b4711-044a-4c9b-aee2-1b891c0aabb5" released by "_delete_snapshot" :: held 2.008s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4171d588-feac-41a3-bf35-701da2a2aa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6660172c-82b1-4690-94f6-4e882d9df5a6', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bc4051-5245-43a1-af79-e0276c1d73c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-c5dda525-d391-483f-9a1f-5c0ff0164a1e" released by "delete_snapshot" :: held 2.057s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:03 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Volume volume-6660172c-82b1-4690-94f6-4e882d9df5a6 (6660172c-82b1-4690-94f6-4e882d9df5a6): created successfully Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bc4051-5245-43a1-af79-e0276c1d73c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Flow 'volume_create_manager' (27bf2f7c-7658-4325-9e99-5d4a5e237beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:03 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ae45b306-4eb3-4469-9b9d-fd4c6ca50f08 tempest-SnapshotMetadataTestJSON-1568209205 None] Created volume successfully. Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Created reservations ['7033f7d1-fb78-4824-bf44-7468343e5dcd', 'e294b3b1-124f-4239-80c5-1e0fbe00b91a', '93e3ad82-c219-455e-9830-1dcd727d1d3a', '6842454e-3400-42c1-85a5-2a9415b79322'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:03 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Delete snapshot completed successfully. Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-d87b4711-044a-4c9b-aee2-1b891c0aabb5-delete_snapshot" released by "delete_snapshot" :: held 2.297s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Snapshots deleted, issuing volume delete {{(pid=86819) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-quobyte-c5dda525-d391-483f-9a1f-5c0ff0164a1e" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-c5dda525-d391-483f-9a1f-5c0ff0164a1e" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f517a46-514e-4c23-81d9-32e98b5280a6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:03 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e Nov 06 10:51:03 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:03 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e" returned: 0 in 0.483s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:03 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e Nov 06 10:51:03 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:04 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c5dda525-d391-483f-9a1f-5c0ff0164a1e" returned: 0 in 0.274s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-c5dda525-d391-483f-9a1f-5c0ff0164a1e" released by "delete_volume" :: held 0.854s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Created reservations ['66a43a2c-64ff-46dd-820f-d1ddf35387b6', '174c38c0-626a-4d4e-8ee2-231a9523656f', '8c6d2395-f093-48a7-8e82-07de9dbfaf86', 'bb43e7b5-8e07-4474-83be-dfb8bdf0d06e'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:04 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:04 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] Creating offline snapshot 7ece0f26-b3e0-48f0-b742-b06546b4329f of volume 6660172c-82b1-4690-94f6-4e882d9df5a6 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a314790-aac7-4f2d-90b8-e7054a2438c5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:04 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6 Nov 06 10:51:04 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:04 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.290s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:04 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Deleted volume successfully. Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-960d3bd6-37cf-4c41-b229-578a3b9413b6 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-c5dda525-d391-483f-9a1f-5c0ff0164a1e-delete_volume" released by "delete_volume" :: held 8.422s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:04 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6" returned: 0 in 0.432s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:04 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f 1G Nov 06 10:51:04 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:05 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f 1G" returned: 0 in 0.517s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6660172c-82b1-4690-94f6-4e882d9df5a6 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:05 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6660172c-82b1-4690-94f6-4e882d9df5a6 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f Nov 06 10:51:05 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:05 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6660172c-82b1-4690-94f6-4e882d9df5a6 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f" returned: 0 in 0.349s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:05 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f is being set with open permissions: ugo+rw Nov 06 10:51:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:05 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f Nov 06 10:51:05 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:06 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f" returned: 0 in 0.267s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:06 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.info Nov 06 10:51:06 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Flow 'volume_create_manager' (bc712da2-4236-4c8a-b4e9-c045cb0e6e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87656d9-c097-4703-8454-75e606eddcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87656d9-c097-4703-8454-75e606eddcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1737196289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade105be-44bd-451c-8a48-6d06caf77efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e7a3e53c54459a8f55c03386004d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:06Z,use_quota=True,user_id='e290b867bf634dcda453250d67fa979f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61da761e-a4a1-47c5-8982-8847ccc7e37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61da761e-a4a1-47c5-8982-8847ccc7e37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b288563e-2aab-4f75-9afd-70a16da0562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b288563e-2aab-4f75-9afd-70a16da0562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ade105be-44bd-451c-8a48-6d06caf77efa', 'volume_name': 'volume-ade105be-44bd-451c-8a48-6d06caf77efa', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:06 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c2ed49-3c7c-4343-b8a8-7a4034e2a2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c2ed49-3c7c-4343-b8a8-7a4034e2a2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3b8282-8b9d-4895-af69-0d132faf8505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:06 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Volume ade105be-44bd-451c-8a48-6d06caf77efa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ade105be-44bd-451c-8a48-6d06caf77efa', 'volume_size': 1} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.info" returned: 0 in 0.321s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:06 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.info is being set with open permissions: ugo+rw Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:06 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.info Nov 06 10:51:06 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:06 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.info" returned: 0 in 0.258s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.285s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1737196289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade105be-44bd-451c-8a48-6d06caf77efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e7a3e53c54459a8f55c03386004d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:06Z,use_quota=True,user_id='e290b867bf634dcda453250d67fa979f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Creating volume ade105be-44bd-451c-8a48-6d06caf77efa {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:06 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:06 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa 1073741824 Nov 06 10:51:06 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:06 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-21c27be6-4b91-47fc-a46b-d9c1ffd161e7 tempest-SnapshotMetadataTestJSON-1568209205 None] Create snapshot completed successfully Nov 06 10:51:07 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa 1073741824" returned: 0 in 0.444s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:07 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa Nov 06 10:51:07 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:07 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa" returned: 0 in 0.251s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:07 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3b8282-8b9d-4895-af69-0d132faf8505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade105be-44bd-451c-8a48-6d06caf77efa', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:07 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040aaa61-5e15-4606-8bb6-d90c8bdd97d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:07 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Volume volume-ade105be-44bd-451c-8a48-6d06caf77efa (ade105be-44bd-451c-8a48-6d06caf77efa): created successfully Nov 06 10:51:07 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040aaa61-5e15-4606-8bb6-d90c8bdd97d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:07 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Flow 'volume_create_manager' (bc712da2-4236-4c8a-b4e9-c045cb0e6e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:07 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-61962440-f5a7-4f2d-a00e-9012fd816b82 tempest-VolumesDeleteCascade-531229256 None] Created volume successfully. Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Acquiring lock "cinder-7ece0f26-b3e0-48f0-b742-b06546b4329f-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "cinder-7ece0f26-b3e0-48f0-b742-b06546b4329f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Acquiring lock "cinder-quobyte-6660172c-82b1-4690-94f6-4e882d9df5a6" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "cinder-quobyte-6660172c-82b1-4690-94f6-4e882d9df5a6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Acquiring lock "cinder-quobyte-7ece0f26-b3e0-48f0-b742-b06546b4329f" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "cinder-quobyte-7ece0f26-b3e0-48f0-b742-b06546b4329f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Deleting offline snapshot 7ece0f26-b3e0-48f0-b742-b06546b4329f of volume 6660172c-82b1-4690-94f6-4e882d9df5a6 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] snapshot_file for this snap is: volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4ef557-4393-46da-92c8-3e9913466aca]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] Creating offline snapshot b6abc605-cf1e-4990-b280-2c213638346a of volume ade105be-44bd-451c-8a48-6d06caf77efa {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:51:08 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f Nov 06 10:51:08 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd98057-7001-4fd9-a5d3-60a3919f8f3d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:08 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa Nov 06 10:51:08 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:08 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f" returned: 0 in 0.430s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6660172c-82b1-4690-94f6-4e882d9df5a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:51:09 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f4cfaa-e6d4-44d4-95e0-047a22e5a84c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:09 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa" returned: 0 in 0.423s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:09 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a 1G Nov 06 10:51:09 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:09 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6 Nov 06 10:51:09 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:09 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6" returned: 0 in 0.481s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:09 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f Nov 06 10:51:09 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:09 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a 1G" returned: 0 in 0.565s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ade105be-44bd-451c-8a48-6d06caf77efa -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:09 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ade105be-44bd-451c-8a48-6d06caf77efa -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a Nov 06 10:51:09 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:09 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f" returned: 0 in 0.407s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:09 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f Nov 06 10:51:09 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:10 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ade105be-44bd-451c-8a48-6d06caf77efa -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a" returned: 0 in 0.337s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:10 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a is being set with open permissions: ugo+rw Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:10 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a Nov 06 10:51:10 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:10 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6.7ece0f26-b3e0-48f0-b742-b06546b4329f" returned: 0 in 0.302s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "cinder-quobyte-7ece0f26-b3e0-48f0-b742-b06546b4329f" released by "_delete_snapshot" :: held 1.802s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "cinder-quobyte-6660172c-82b1-4690-94f6-4e882d9df5a6" released by "delete_snapshot" :: held 1.840s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:10 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a" returned: 0 in 0.351s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Created reservations ['79d68db6-7fe8-4f23-b820-a0199c8c1924', 'c252449d-2442-4c84-8f5f-4ddfda7c7f22', 'aae92ae3-1c25-44c4-8793-339f99210213', '98c1415b-03ec-422d-a5c5-bf8411e38c67'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:10 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.info Nov 06 10:51:10 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:10 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Delete snapshot completed successfully. Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0d33e249-0962-423d-9517-b4bf741fe642 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "cinder-7ece0f26-b3e0-48f0-b742-b06546b4329f-delete_snapshot" released by "delete_snapshot" :: held 2.069s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Acquiring lock "cinder-6660172c-82b1-4690-94f6-4e882d9df5a6-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "cinder-6660172c-82b1-4690-94f6-4e882d9df5a6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:10 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.info" returned: 0 in 0.394s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:10 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.info is being set with open permissions: ugo+rw Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Acquiring lock "cinder-quobyte-6660172c-82b1-4690-94f6-4e882d9df5a6" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:10 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.info Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "cinder-quobyte-6660172c-82b1-4690-94f6-4e882d9df5a6" acquired by "delete_volume" :: waited 0.025s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:10 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[629515e3-62a5-4789-8097-ac7bbd6b3c48]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:11 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6 Nov 06 10:51:11 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:11 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.info" returned: 0 in 0.287s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:11 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-549384cc-10a7-44f7-a7c6-792046190966 tempest-VolumesDeleteCascade-531229256 None] Create snapshot completed successfully Nov 06 10:51:11 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6" returned: 0 in 0.501s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:11 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6 Nov 06 10:51:11 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:11 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6660172c-82b1-4690-94f6-4e882d9df5a6" returned: 0 in 0.270s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "cinder-quobyte-6660172c-82b1-4690-94f6-4e882d9df5a6" released by "delete_volume" :: held 0.873s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:11 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Created reservations ['3eedfe79-2eb4-40ea-a0be-0697a297c11d', 'c52318d2-f412-4638-8db7-5a16821b7cd8', '91b20bc2-41a9-4112-8e2e-26b00593eb1f', 'a8474a32-8242-44e3-926f-7685702599ab'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:11 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:11 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:12 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.299s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:12 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Deleted volume successfully. Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=117,cinder:UPDATE=143,cinder:INSERT=40,cinder:DELETE=8 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4c496cc8-f16a-44ad-af80-7355e7ab3b47 tempest-SnapshotMetadataTestJSON-1568209205 None] Lock "cinder-6660172c-82b1-4690-94f6-4e882d9df5a6-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Flow 'volume_create_manager' (7985cddd-2f30-4f11-bd7e-d5766fcad3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b99749-633e-4b2d-ab63-d1955ccf2252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b99749-633e-4b2d-ab63-d1955ccf2252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1581425462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd672de-3317-4416-bc0b-dd28f5d55dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e7a3e53c54459a8f55c03386004d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6abc605-cf1e-4990-b280-2c213638346a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:12Z,use_quota=True,user_id='e290b867bf634dcda453250d67fa979f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747b64d3-72f3-465d-95c0-9158a1e1103a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747b64d3-72f3-465d-95c0-9158a1e1103a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f807b3-f0be-482b-b8b7-ce008c5a5f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f807b3-f0be-482b-b8b7-ce008c5a5f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5fd672de-3317-4416-bc0b-dd28f5d55dcf', 'volume_name': 'volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf', 'volume_size': 1, 'snapshot_id': 'b6abc605-cf1e-4990-b280-2c213638346a'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8f1eec-9e96-49de-b7cd-856dfc62f57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8f1eec-9e96-49de-b7cd-856dfc62f57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b929629-3c21-4b3a-a73f-b4b27e0e16c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:12 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Volume 5fd672de-3317-4416-bc0b-dd28f5d55dcf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf', 'volume_size': 1, 'snapshot_id': 'b6abc605-cf1e-4990-b280-2c213638346a'} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-quobyte-b6abc605-cf1e-4990-b280-2c213638346a-5fd672de-3317-4416-bc0b-dd28f5d55dcf" by "_create_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-b6abc605-cf1e-4990-b280-2c213638346a-5fd672de-3317-4416-bc0b-dd28f5d55dcf" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Creating volume 5fd672de-3317-4416-bc0b-dd28f5d55dcf from snapshot b6abc605-cf1e-4990-b280-2c213638346a {{(pid=86819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-quobyte-5fd672de-3317-4416-bc0b-dd28f5d55dcf" by "_copy_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-5fd672de-3317-4416-bc0b-dd28f5d55dcf" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] snapshot: b6abc605-cf1e-4990-b280-2c213638346a, volume: 5fd672de-3317-4416-bc0b-dd28f5d55dcf, {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e08570-8474-4372-a5b8-69cf6b9033e0]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:12 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a Nov 06 10:51:12 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:13 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a" returned: 0 in 0.398s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ade105be-44bd-451c-8a48-6d06caf77efa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:51:13 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3fea7d-b585-474a-ad06-7d31cfcc8120]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:13 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa Nov 06 10:51:13 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:13 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa" returned: 0 in 0.432s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] will copy from snapshot at /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 10:51:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Creating direct copy from snapshot {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 10:51:13 devstack cinder-volume[86819]: DEBUG cinder.utils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Path /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf not found in is_blk_device check {{(pid=86819) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 10:51:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:13 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf Nov 06 10:51:13 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:17 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Flow 'volume_create_manager' (cc3ef4bb-80ef-4c9c-8ca6-a129d227621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23824ef6-d24c-4457-b187-cb1b1b495b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23824ef6-d24c-4457-b187-cb1b1b495b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-212774871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde21378-b3da-4705-825e-0cc06fa499ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f00dd33bf30b48cc82dcb26127371f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:17Z,use_quota=True,user_id='e93f6bf5d7ca42928af1a8631cec436f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb0aa75-ba58-4f4a-9dea-609f900ff070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb0aa75-ba58-4f4a-9dea-609f900ff070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee671e49-e03d-4e74-9e7a-c22a0e72923d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee671e49-e03d-4e74-9e7a-c22a0e72923d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cde21378-b3da-4705-825e-0cc06fa499ff', 'volume_name': 'volume-cde21378-b3da-4705-825e-0cc06fa499ff', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe9f556-c760-4b9a-a536-2ac4ef5ceffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe9f556-c760-4b9a-a536-2ac4ef5ceffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6658bbad-3825-4f6e-a4dd-927756807393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:17 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Volume cde21378-b3da-4705-825e-0cc06fa499ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cde21378-b3da-4705-825e-0cc06fa499ff', 'volume_size': 1} Nov 06 10:51:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Flow 'volume_create_manager' (c9870a42-9e21-4181-bf72-f2e7dc68186c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46580f57-f542-4884-b03c-32eab201e74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46580f57-f542-4884-b03c-32eab201e74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-566674701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed12711a-6540-4cb4-ab78-1d4ce0af42fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865a11bda9d34c6da4aa7b146208a019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:20Z,use_quota=True,user_id='dd89294ee75341f1a48fec89ad269637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8ebc74-0b73-4f3d-9e90-042d158d309c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8ebc74-0b73-4f3d-9e90-042d158d309c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1da2d9-2c76-4ce3-bb12-d441967344f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1da2d9-2c76-4ce3-bb12-d441967344f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed12711a-6540-4cb4-ab78-1d4ce0af42fe', 'volume_name': 'volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a779123f-7f30-478b-a0b5-5a0b56aa3535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a779123f-7f30-478b-a0b5-5a0b56aa3535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f382ff4b-5c3e-4776-b047-063955704814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:20 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Volume ed12711a-6540-4cb4-ab78-1d4ce0af42fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe', 'volume_size': 1} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Flow 'volume_create_manager' (1df67fad-7978-4467-9ef0-bfb32bc9670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a79d40f-04ea-421b-bd20-19064d49fb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a79d40f-04ea-421b-bd20-19064d49fb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae83ed0a-387d-45af-9382-8cdd64d5a4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e515d2f584474fb48cf1feacf6211b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:21Z,use_quota=True,user_id='cab9b8551627435d9f262e1f15538706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f17f13f-66ab-4361-ae62-cc521dd8ac09),volume_type_id=3f17f13f-66ab-4361-ae62-cc521dd8ac09)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84240fd-50ce-4ac2-88a8-885619b1e682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84240fd-50ce-4ac2-88a8-885619b1e682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229fdf45-29c4-4a1c-8ab3-a3014be45d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:20 devstack cinder-volume[86819]: DEBUG cinder.image.glance [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Creating Keystone auth plugin from conf {{(pid=86819) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 10:51:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229fdf45-29c4-4a1c-8ab3-a3014be45d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae83ed0a-387d-45af-9382-8cdd64d5a4c9', 'volume_name': 'volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9', 'volume_size': 1, 'image_id': 'e1f1edb3-d08c-43ea-8b50-90c725114fe9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1f1edb3-d08c-43ea-8b50-90c725114fe9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '46d40abeb501fb9f9d894bddd989c496', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e515d2f584474fb48cf1feacf6211b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82d2648d29a24cad0fcc599073ad11701bbc7534e752b9424c3f5f423c69dcbf6500056b44699edd09a9512adcb3711137ebf7788591ff6ed472299b9d904dd1', 'id': 'e1f1edb3-d08c-43ea-8b50-90c725114fe9', 'created_at': datetime.datetime(2026, 11, 6, 9, 51, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 51, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1f1edb3-d08c-43ea-8b50-90c725114fe9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d14144-3aa9-4f14-98a7-48b29339927d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d14144-3aa9-4f14-98a7-48b29339927d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d3551e-df5a-401a-a021-32350c8b6a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:21 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Volume ae83ed0a-387d-45af-9382-8cdd64d5a4c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9', 'volume_size': 1, 'image_id': 'e1f1edb3-d08c-43ea-8b50-90c725114fe9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1f1edb3-d08c-43ea-8b50-90c725114fe9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '46d40abeb501fb9f9d894bddd989c496', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e515d2f584474fb48cf1feacf6211b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82d2648d29a24cad0fcc599073ad11701bbc7534e752b9424c3f5f423c69dcbf6500056b44699edd09a9512adcb3711137ebf7788591ff6ed472299b9d904dd1', 'id': 'e1f1edb3-d08c-43ea-8b50-90c725114fe9', 'created_at': datetime.datetime(2026, 11, 6, 9, 51, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 51, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1f1edb3-d08c-43ea-8b50-90c725114fe9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 10:51:21 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Trying to clone ae83ed0a-387d-45af-9382-8cdd64d5a4c9 from image e1f1edb3-d08c-43ea-8b50-90c725114fe9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e1f1edb3-d08c-43ea-8b50-90c725114fe9', 'metadata': {}}]). {{(pid=86819) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 10:51:21 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 10:51:21 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Image download 0.00 MB at 0.00 MB/s Nov 06 10:51:21 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[865d378e-dad0-4242-a955-bb20bc821cc7]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:21 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD Nov 06 10:51:21 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:21 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:21 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD Nov 06 10:51:21 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:22 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD" returned: 1 in 0.429s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Temporary image e1f1edb3-d08c-43ea-8b50-90c725114fe9 is fetched for user cab9b8551627435d9f262e1f15538706. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d57520-59c8-4fd5-bc41-40f9b78941d8]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:22 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf" returned: 0 in 8.758s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Image conversion details: src /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa, size 1024.00 MB, duration 8.76 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:51:22 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Converted 1024.00 MB image at 116.91 MB/s Nov 06 10:51:22 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf is being set with open permissions: ugo+rw Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:22 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf Nov 06 10:51:22 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:22 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD Nov 06 10:51:22 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:22 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf" returned: 0 in 0.295s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-5fd672de-3317-4416-bc0b-dd28f5d55dcf" released by "_copy_volume_from_snapshot" :: held 10.000s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:22 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-b6abc605-cf1e-4990-b280-2c213638346a-5fd672de-3317-4416-bc0b-dd28f5d55dcf" released by "_create_volume_from_snapshot" :: held 10.099s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.122s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.322s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-212774871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde21378-b3da-4705-825e-0cc06fa499ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f00dd33bf30b48cc82dcb26127371f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:17Z,use_quota=True,user_id='e93f6bf5d7ca42928af1a8631cec436f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Creating volume cde21378-b3da-4705-825e-0cc06fa499ff {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:22 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cde21378-b3da-4705-825e-0cc06fa499ff 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:22 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cde21378-b3da-4705-825e-0cc06fa499ff 1073741824 Nov 06 10:51:22 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b929629-3c21-4b3a-a73f-b4b27e0e16c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf', 'volume_size': 1, 'snapshot_id': 'b6abc605-cf1e-4990-b280-2c213638346a'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5777ec65-2201-442a-b545-3600a3686995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:22 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD Nov 06 10:51:22 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:22 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Volume volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf (5fd672de-3317-4416-bc0b-dd28f5d55dcf): created successfully Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5777ec65-2201-442a-b545-3600a3686995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Flow 'volume_create_manager' (7985cddd-2f30-4f11-bd7e-d5766fcad3de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:22 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-e75d92b6-7f99-4e24-9214-4821b17626ba tempest-VolumesDeleteCascade-531229256 None] Created volume successfully. Nov 06 10:51:23 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:23 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cde21378-b3da-4705-825e-0cc06fa499ff 1073741824" returned: 0 in 0.435s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cde21378-b3da-4705-825e-0cc06fa499ff {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:23 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cde21378-b3da-4705-825e-0cc06fa499ff Nov 06 10:51:23 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:23 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cde21378-b3da-4705-825e-0cc06fa499ff" returned: 0 in 0.246s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.183s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-566674701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed12711a-6540-4cb4-ab78-1d4ce0af42fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865a11bda9d34c6da4aa7b146208a019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:20Z,use_quota=True,user_id='dd89294ee75341f1a48fec89ad269637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Creating volume ed12711a-6540-4cb4-ab78-1d4ce0af42fe {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:23 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:23 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe 1073741824 Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6658bbad-3825-4f6e-a4dd-927756807393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde21378-b3da-4705-825e-0cc06fa499ff', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:23 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff302293-e461-4feb-a599-75eb2e7cc2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:23 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Volume volume-cde21378-b3da-4705-825e-0cc06fa499ff (cde21378-b3da-4705-825e-0cc06fa499ff): created successfully Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff302293-e461-4feb-a599-75eb2e7cc2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Flow 'volume_create_manager' (cc3ef4bb-80ef-4c9c-8ca6-a129d227621b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-debdbd6d-e0be-45db-8914-c417c4c3a0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Created volume successfully. Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-ade105be-44bd-451c-8a48-6d06caf77efa-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-ade105be-44bd-451c-8a48-6d06caf77efa-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Performing cascade delete. {{(pid=86819) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-b6abc605-cf1e-4990-b280-2c213638346a-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-b6abc605-cf1e-4990-b280-2c213638346a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-quobyte-ade105be-44bd-451c-8a48-6d06caf77efa" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-ade105be-44bd-451c-8a48-6d06caf77efa" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-quobyte-b6abc605-cf1e-4990-b280-2c213638346a" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-b6abc605-cf1e-4990-b280-2c213638346a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Deleting offline snapshot b6abc605-cf1e-4990-b280-2c213638346a of volume ade105be-44bd-451c-8a48-6d06caf77efa {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] snapshot_file for this snap is: volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1909d2-fe76-4ed1-8096-d402f57cbe61]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:23 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe 1073741824" returned: 0 in 0.486s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:24 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe Nov 06 10:51:24 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:24 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a Nov 06 10:51:24 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:24 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe" returned: 0 in 0.255s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.235s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae83ed0a-387d-45af-9382-8cdd64d5a4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e515d2f584474fb48cf1feacf6211b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:21Z,use_quota=True,user_id='cab9b8551627435d9f262e1f15538706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f17f13f-66ab-4361-ae62-cc521dd8ac09),volume_type_id=3f17f13f-66ab-4361-ae62-cc521dd8ac09)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Creating volume ae83ed0a-387d-45af-9382-8cdd64d5a4c9 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:24 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f382ff4b-5c3e-4776-b047-063955704814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567b4971-e5c0-4bbc-9bc8-c5c41f9a8298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:24 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 1073741824 Nov 06 10:51:24 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:24 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:24 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Volume volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe (ed12711a-6540-4cb4-ab78-1d4ce0af42fe): created successfully Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567b4971-e5c0-4bbc-9bc8-c5c41f9a8298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Flow 'volume_create_manager' (c9870a42-9e21-4181-bf72-f2e7dc68186c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a" returned: 0 in 0.390s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ade105be-44bd-451c-8a48-6d06caf77efa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:51:24 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2a907f59-ee0e-491d-95ad-e56ac6b78c34 tempest-VolumesMetadataTest-730726451 None] Created volume successfully. Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e96463-2b07-436a-bd0e-ab3e01b13da4]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:24 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa Nov 06 10:51:24 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:24 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 1073741824" returned: 0 in 0.526s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:24 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 Nov 06 10:51:24 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:25 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa" returned: 0 in 0.605s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:25 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a Nov 06 10:51:25 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:25 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9" returned: 0 in 0.317s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Attempting download of e1f1edb3-d08c-43ea-8b50-90c725114fe9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e1f1edb3-d08c-43ea-8b50-90c725114fe9', 'metadata': {}}])) to volume ae83ed0a-387d-45af-9382-8cdd64d5a4c9. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58a66d8-ff56-4d36-8a96-24a2432b90b2]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1f1edb3-d08c-43ea-8b50-90c725114fe9_ahwq09bl {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:25 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1f1edb3-d08c-43ea-8b50-90c725114fe9_ahwq09bl Nov 06 10:51:25 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:25 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a" returned: 0 in 0.484s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-c97ca8db-6507-4c4a-81e0-faf9d4be7bc1 req-3ef1f307-0a70-456e-8893-662a9984d3af tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-c97ca8db-6507-4c4a-81e0-faf9d4be7bc1 req-3ef1f307-0a70-456e-8893-662a9984d3af tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:25 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a Nov 06 10:51:25 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-c97ca8db-6507-4c4a-81e0-faf9d4be7bc1 req-3ef1f307-0a70-456e-8893-662a9984d3af tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-c97ca8db-6507-4c4a-81e0-faf9d4be7bc1 req-3ef1f307-0a70-456e-8893-662a9984d3af tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-cde21378-b3da-4705-825e-0cc06fa499ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64a343cd-25b1-44c2-a65a-4a6d01e29545', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:51:25 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-c97ca8db-6507-4c4a-81e0-faf9d4be7bc1 req-3ef1f307-0a70-456e-8893-662a9984d3af tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] attachment_update completed successfully. Nov 06 10:51:25 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1f1edb3-d08c-43ea-8b50-90c725114fe9_ahwq09bl" returned: 0 in 0.386s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1f1edb3-d08c-43ea-8b50-90c725114fe9_ahwq09bl {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:25 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1f1edb3-d08c-43ea-8b50-90c725114fe9_ahwq09bl Nov 06 10:51:25 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:25 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa.b6abc605-cf1e-4990-b280-2c213638346a" returned: 0 in 0.324s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-b6abc605-cf1e-4990-b280-2c213638346a" released by "_delete_snapshot" :: held 1.926s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-ade105be-44bd-451c-8a48-6d06caf77efa" released by "delete_snapshot" :: held 1.957s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:25 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Created reservations ['28571ee4-dcb3-4a7d-a558-f8e7a696571a', 'ee119d3e-04bb-4d02-9e09-4de0f3060b2a', '5523c770-8256-4ff8-806a-1e621d0e8969', '26700488-0ab6-4669-b525-587070c29ee0'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:26 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Delete snapshot completed successfully. Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-b6abc605-cf1e-4990-b280-2c213638346a-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Snapshots deleted, issuing volume delete {{(pid=86819) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-quobyte-ade105be-44bd-451c-8a48-6d06caf77efa" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:26 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1f1edb3-d08c-43ea-8b50-90c725114fe9_ahwq09bl" returned: 1 in 0.474s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1f1edb3-d08c-43ea-8b50-90c725114fe9_ahwq09bl' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-ade105be-44bd-451c-8a48-6d06caf77efa" acquired by "delete_volume" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f1ab1b-a2e5-4315-906a-6b5a3511037e]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b203b0-6d95-4cc3-9b26-0ddef3e22d92]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:26 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD Nov 06 10:51:26 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa Nov 06 10:51:26 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:26 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Acquiring lock "cinder-ed12711a-6540-4cb4-ab78-1d4ce0af42fe-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Lock "cinder-ed12711a-6540-4cb4-ab78-1d4ce0af42fe-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Acquiring lock "cinder-quobyte-ed12711a-6540-4cb4-ab78-1d4ce0af42fe" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Lock "cinder-quobyte-ed12711a-6540-4cb4-ab78-1d4ce0af42fe" acquired by "delete_volume" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d344c87-c3dd-4068-9933-8243bd6db197]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:26 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD" returned: 0 in 0.519s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:26 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa" returned: 0 in 0.508s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:26 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe Nov 06 10:51:26 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:26 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa Nov 06 10:51:26 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:26 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD Nov 06 10:51:26 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:27 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe" returned: 0 in 0.442s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:27 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ade105be-44bd-451c-8a48-6d06caf77efa" returned: 0 in 0.330s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:27 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe Nov 06 10:51:27 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-ade105be-44bd-451c-8a48-6d06caf77efa" released by "delete_volume" :: held 0.944s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:27 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] e1f1edb3-d08c-43ea-8b50-90c725114fe9 was raw, converting to qcow2 {{(pid=86819) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:27 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 Nov 06 10:51:27 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Created reservations ['72c747bf-48fc-4f5f-a9be-49de55eee295', 'c7bf878c-26d1-4acd-8a30-6795901142f5', '278571eb-ab07-453c-b396-c403e785781b', '02fbefab-ea79-48bf-809b-b2f358080218'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:27 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:27 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:27 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ed12711a-6540-4cb4-ab78-1d4ce0af42fe" returned: 0 in 0.297s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Lock "cinder-quobyte-ed12711a-6540-4cb4-ab78-1d4ce0af42fe" released by "delete_volume" :: held 0.807s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Created reservations ['c7613366-868e-4010-ab62-977fec894f16', 'e31db538-372c-48b4-a76a-6d32aa9f9a7b', 'd4468fc3-5ea9-4970-bf37-24460fe6ab2c', '9cf66569-f4d4-4016-acc4-34b0054bec47'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:27 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:27 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:27 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.355s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:27 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Deleted volume successfully. Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-952dc76e-3ece-4fc6-88e3-3aec336227a0 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-ade105be-44bd-451c-8a48-6d06caf77efa-delete_volume" released by "delete_volume" :: held 3.826s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:27 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9" returned: 0 in 0.588s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e1f1edb3-d08c-43ea-8b50-90c725114fe9_q34e3aaxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:51:27 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:27 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 1G Nov 06 10:51:27 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:27 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.276s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:27 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Deleted volume successfully. Nov 06 10:51:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f3589dab-e38a-4d0a-bbb3-4f18c01982b6 tempest-VolumesMetadataTest-730726451 None] Lock "cinder-ed12711a-6540-4cb4-ab78-1d4ce0af42fe-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:28 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 1G" returned: 0 in 0.385s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Downloaded image e1f1edb3-d08c-43ea-8b50-90c725114fe9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e1f1edb3-d08c-43ea-8b50-90c725114fe9', 'metadata': {}}])) to volume ae83ed0a-387d-45af-9382-8cdd64d5a4c9 successfully. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Temporary image e1f1edb3-d08c-43ea-8b50-90c725114fe9 for user cab9b8551627435d9f262e1f15538706 is deleted. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Marking volume ae83ed0a-387d-45af-9382-8cdd64d5a4c9 as bootable. {{(pid=86819) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Copying metadata from image e1f1edb3-d08c-43ea-8b50-90c725114fe9 to ae83ed0a-387d-45af-9382-8cdd64d5a4c9. {{(pid=86819) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Creating volume glance metadata for volume ae83ed0a-387d-45af-9382-8cdd64d5a4c9 backed by image e1f1edb3-d08c-43ea-8b50-90c725114fe9 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e1f1edb3-d08c-43ea-8b50-90c725114fe9', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '46d40abeb501fb9f9d894bddd989c496', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86819) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d3551e-df5a-401a-a021-32350c8b6a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9', 'volume_size': 1, 'image_id': 'e1f1edb3-d08c-43ea-8b50-90c725114fe9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1f1edb3-d08c-43ea-8b50-90c725114fe9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '46d40abeb501fb9f9d894bddd989c496', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e515d2f584474fb48cf1feacf6211b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82d2648d29a24cad0fcc599073ad11701bbc7534e752b9424c3f5f423c69dcbf6500056b44699edd09a9512adcb3711137ebf7788591ff6ed472299b9d904dd1', 'id': 'e1f1edb3-d08c-43ea-8b50-90c725114fe9', 'created_at': datetime.datetime(2026, 11, 6, 9, 51, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 51, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1f1edb3-d08c-43ea-8b50-90c725114fe9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f1a2c8-bb31-4064-ade7-db6acdfec970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:28 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Volume volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 (ae83ed0a-387d-45af-9382-8cdd64d5a4c9): created successfully Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f1a2c8-bb31-4064-ade7-db6acdfec970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Flow 'volume_create_manager' (1df67fad-7978-4467-9ef0-bfb32bc9670e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:28 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-fb9ce672-cf84-4671-a78f-18dead240b54 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Created volume successfully. Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-5fd672de-3317-4416-bc0b-dd28f5d55dcf-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-5fd672de-3317-4416-bc0b-dd28f5d55dcf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "cinder-quobyte-5fd672de-3317-4416-bc0b-dd28f5d55dcf" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-5fd672de-3317-4416-bc0b-dd28f5d55dcf" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb214b5d-7d2e-4efa-a4ed-69031814fa04]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:28 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf Nov 06 10:51:28 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:28 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf" returned: 0 in 0.452s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:29 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf Nov 06 10:51:29 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Acquiring lock "cinder-ae83ed0a-387d-45af-9382-8cdd64d5a4c9-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Lock "cinder-ae83ed0a-387d-45af-9382-8cdd64d5a4c9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Acquiring lock "cinder-quobyte-ae83ed0a-387d-45af-9382-8cdd64d5a4c9" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Lock "cinder-quobyte-ae83ed0a-387d-45af-9382-8cdd64d5a4c9" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad04701-4a66-45bc-acb1-774ceee7bdc6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:29 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5fd672de-3317-4416-bc0b-dd28f5d55dcf" returned: 0 in 0.419s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-quobyte-5fd672de-3317-4416-bc0b-dd28f5d55dcf" released by "delete_volume" :: held 0.927s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Created reservations ['f6e254e1-13e1-489f-9bdd-45dc2c2c870d', '9c75053d-68a8-45ec-8a2f-c6a7953d8337', '17e0e55e-9137-4eab-9d33-614ea35dfa81', 'f3982839-81ba-430c-ac29-6d757b089e28'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:29 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 Nov 06 10:51:29 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:29 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-64d29822-a100-45e8-9902-9325b46bdf25 req-a523ebb4-be8c-487b-a7b5-5d3571ed6fba tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Terminate volume connection completed successfully. Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-64d29822-a100-45e8-9902-9325b46bdf25 req-a523ebb4-be8c-487b-a7b5-5d3571ed6fba tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Deleting attachment 64a343cd-25b1-44c2-a65a-4a6d01e29545. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:29 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:29 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:29 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9" returned: 0 in 0.490s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:29 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9 Nov 06 10:51:29 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:29 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.364s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:29 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Deleted volume successfully. Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c5cac097-439d-4f3b-a227-e5c41aec9398 tempest-VolumesDeleteCascade-531229256 None] Lock "cinder-5fd672de-3317-4416-bc0b-dd28f5d55dcf-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:30 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ae83ed0a-387d-45af-9382-8cdd64d5a4c9" returned: 0 in 0.333s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Lock "cinder-quobyte-ae83ed0a-387d-45af-9382-8cdd64d5a4c9" released by "delete_volume" :: held 0.895s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:30 devstack cinder-volume[86819]: WARNING cinder.quota [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:51:30 devstack cinder-volume[86819]: WARNING cinder.quota [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Created reservations ['24bb0145-445c-47fe-a888-88661c7754c5', '0cf0d477-3a32-48b6-9f95-9c7d2cf297bf', 'bb932637-c984-45ca-91b1-1522a27f734e', 'ebcb5bc7-a0b9-4e35-99c5-0ad3d297e3ab'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:30 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:30 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Acquiring lock "cinder-cde21378-b3da-4705-825e-0cc06fa499ff-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Lock "cinder-cde21378-b3da-4705-825e-0cc06fa499ff-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Acquiring lock "cinder-quobyte-cde21378-b3da-4705-825e-0cc06fa499ff" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Lock "cinder-quobyte-cde21378-b3da-4705-825e-0cc06fa499ff" acquired by "delete_volume" :: waited 0.033s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcbc181-c96a-410a-a918-20396f4f3524]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cde21378-b3da-4705-825e-0cc06fa499ff {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:30 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.380s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Deleted volume successfully. Nov 06 10:51:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e4000f99-466f-483b-a21e-9b38bb2b9e42 tempest-VolumeAndVolumeTypeFromImageTest-404790217 None] Lock "cinder-ae83ed0a-387d-45af-9382-8cdd64d5a4c9-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:30 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cde21378-b3da-4705-825e-0cc06fa499ff Nov 06 10:51:30 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:31 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cde21378-b3da-4705-825e-0cc06fa499ff" returned: 0 in 0.520s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cde21378-b3da-4705-825e-0cc06fa499ff {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:31 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cde21378-b3da-4705-825e-0cc06fa499ff Nov 06 10:51:31 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:31 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cde21378-b3da-4705-825e-0cc06fa499ff" returned: 0 in 0.309s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Lock "cinder-quobyte-cde21378-b3da-4705-825e-0cc06fa499ff" released by "delete_volume" :: held 0.888s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:31 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Created reservations ['b625bae3-e319-4737-a00e-61f9f87e343e', '112255a1-d2f7-4080-b1cc-73d703719695', '484b340f-8ee2-428a-9c87-a7ee6b5ffb30', '113330a8-8711-49c1-b863-fd0b2c5d149e'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:31 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:31 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:32 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.278s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:32 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:32 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Deleted volume successfully. Nov 06 10:51:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-53804acf-a202-4289-a8cf-8b402ce0fc04 tempest-TestServerVolumeAttachScenarioOldVersion-1112610742 None] Lock "cinder-cde21378-b3da-4705-825e-0cc06fa499ff-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Flow 'volume_create_manager' (c9b03eec-39c4-46d2-975c-ecf720cf2102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12505de8-3f1c-4d22-b55b-ef64710afe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12505de8-3f1c-4d22-b55b-ef64710afe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1042600125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0867cbb0e2d64690baebabe055d1cb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:36Z,use_quota=True,user_id='52bc3eff69cf4f709b181d80eb3b6932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db36f208-b343-4977-bf0e-63fd897fe1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db36f208-b343-4977-bf0e-63fd897fe1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4a59ff-c2c4-4fcb-ad33-5c2b23048585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4a59ff-c2c4-4fcb-ad33-5c2b23048585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012', 'volume_name': 'volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc0ec9b-8d06-47fe-bf51-65efec657c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc0ec9b-8d06-47fe-bf51-65efec657c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c10d19-1298-4477-9aca-ccd51343915c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:35 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Volume d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012', 'volume_size': 1} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1042600125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0867cbb0e2d64690baebabe055d1cb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:36Z,use_quota=True,user_id='52bc3eff69cf4f709b181d80eb3b6932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Creating volume d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:35 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:35 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012 1073741824 Nov 06 10:51:35 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:36 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:36 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:36 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.335s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 29 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:51:36 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012 1073741824" returned: 0 in 0.654s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:36 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012 Nov 06 10:51:36 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:36 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012" returned: 0 in 0.304s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c10d19-1298-4477-9aca-ccd51343915c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f1ffad-e5ce-46e0-98c1-c9a6b5e42a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:36 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Volume volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012 (d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012): created successfully Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f1ffad-e5ce-46e0-98c1-c9a6b5e42a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Flow 'volume_create_manager' (c9b03eec-39c4-46d2-975c-ecf720cf2102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:36 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a729577b-fcd1-4427-872e-907b1233e3ef tempest-VolumesTransfersTest-1643067444 None] Created volume successfully. Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Flow 'volume_create_manager' (41b22c92-5481-4436-972f-a2e9757a540a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f4b75c-f8b5-4f04-b500-f5c90620d3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f4b75c-f8b5-4f04-b500-f5c90620d3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-944444251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001ca509-eecf-4de7-a30b-ad0337b3daa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8637a921fbd14f039c229a881a7a2fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:38Z,use_quota=True,user_id='83ea29e12c1747b4b4b278e9a2f5e258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e245990a-f42d-4a78-8365-78e1397e845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e245990a-f42d-4a78-8365-78e1397e845e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274fd928-f489-415c-b505-71b9215e225e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274fd928-f489-415c-b505-71b9215e225e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '001ca509-eecf-4de7-a30b-ad0337b3daa5', 'volume_name': 'volume-001ca509-eecf-4de7-a30b-ad0337b3daa5', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8f5a9c-6f49-4797-a37a-8be69d349d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8f5a9c-6f49-4797-a37a-8be69d349d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc88301-06e8-4a81-937f-8b1fa8979424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:37 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume 001ca509-eecf-4de7-a30b-ad0337b3daa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-001ca509-eecf-4de7-a30b-ad0337b3daa5', 'volume_size': 1} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-944444251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001ca509-eecf-4de7-a30b-ad0337b3daa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8637a921fbd14f039c229a881a7a2fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:38Z,use_quota=True,user_id='83ea29e12c1747b4b4b278e9a2f5e258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Creating volume 001ca509-eecf-4de7-a30b-ad0337b3daa5 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:37 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-001ca509-eecf-4de7-a30b-ad0337b3daa5 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:37 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-001ca509-eecf-4de7-a30b-ad0337b3daa5 1073741824 Nov 06 10:51:37 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Flow 'volume_create_manager' (c4994185-9d55-4158-a05b-34092317c307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177e2fef-8f5f-48c0-b201-10486741aa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177e2fef-8f5f-48c0-b201-10486741aa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1447848308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c300e7-312f-4286-bff4-c40796b28cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabec1d4685c49d1afa0aca6ad032f1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:38Z,use_quota=True,user_id='9b12df0869234242ac3befc64bfdda36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a90393-b5f7-4788-8d24-5d91df0fec79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a90393-b5f7-4788-8d24-5d91df0fec79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537583fd-3b18-4cf4-b401-835091fb5658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537583fd-3b18-4cf4-b401-835091fb5658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c300e7-312f-4286-bff4-c40796b28cc7', 'volume_name': 'volume-76c300e7-312f-4286-bff4-c40796b28cc7', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3c7750-bea2-4c59-b837-ed46a78fbe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3c7750-bea2-4c59-b837-ed46a78fbe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da046cca-5856-44d9-872f-a4962e61e762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:38 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Volume 76c300e7-312f-4286-bff4-c40796b28cc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c300e7-312f-4286-bff4-c40796b28cc7', 'volume_size': 1} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:38 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-76008250-533f-47ba-89b1-7d00b3b0d3f4 tempest-VolumesTransfersTest-1026326222 None] Transfer volume completed successfully. Nov 06 10:51:38 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-001ca509-eecf-4de7-a30b-ad0337b3daa5 1073741824" returned: 0 in 0.672s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-001ca509-eecf-4de7-a30b-ad0337b3daa5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:38 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-001ca509-eecf-4de7-a30b-ad0337b3daa5 Nov 06 10:51:38 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:38 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-001ca509-eecf-4de7-a30b-ad0337b3daa5" returned: 0 in 0.264s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.823s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1447848308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c300e7-312f-4286-bff4-c40796b28cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabec1d4685c49d1afa0aca6ad032f1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:38Z,use_quota=True,user_id='9b12df0869234242ac3befc64bfdda36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Creating volume 76c300e7-312f-4286-bff4-c40796b28cc7 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:38 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-76c300e7-312f-4286-bff4-c40796b28cc7 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc88301-06e8-4a81-937f-8b1fa8979424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-001ca509-eecf-4de7-a30b-ad0337b3daa5', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245eeb88-8f9f-4bdb-b1cb-c645d4e667c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:38 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-76c300e7-312f-4286-bff4-c40796b28cc7 1073741824 Nov 06 10:51:38 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:38 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume volume-001ca509-eecf-4de7-a30b-ad0337b3daa5 (001ca509-eecf-4de7-a30b-ad0337b3daa5): created successfully Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245eeb88-8f9f-4bdb-b1cb-c645d4e667c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Flow 'volume_create_manager' (41b22c92-5481-4436-972f-a2e9757a540a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:38 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9da7c810-2fcd-4232-947a-f975a8fc4683 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Created volume successfully. Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Acquiring lock "cinder-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Lock "cinder-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Acquiring lock "cinder-quobyte-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Lock "cinder-quobyte-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5295ec5d-59da-48fe-a2ed-25be2c542c1c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:39 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012 Nov 06 10:51:39 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:39 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-76c300e7-312f-4286-bff4-c40796b28cc7 1073741824" returned: 0 in 0.593s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-76c300e7-312f-4286-bff4-c40796b28cc7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:39 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-76c300e7-312f-4286-bff4-c40796b28cc7 Nov 06 10:51:39 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:39 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012" returned: 0 in 0.500s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:39 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012 Nov 06 10:51:39 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:39 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-76c300e7-312f-4286-bff4-c40796b28cc7" returned: 0 in 0.344s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da046cca-5856-44d9-872f-a4962e61e762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c300e7-312f-4286-bff4-c40796b28cc7', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ea6350-9349-4c4d-9813-f1ae395410ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:39 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Volume volume-76c300e7-312f-4286-bff4-c40796b28cc7 (76c300e7-312f-4286-bff4-c40796b28cc7): created successfully Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ea6350-9349-4c4d-9813-f1ae395410ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Flow 'volume_create_manager' (c4994185-9d55-4158-a05b-34092317c307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:39 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-06c79505-2798-4961-90b3-ee66c535ada1 tempest-VolumesTransfersV355Test-653242116 None] Created volume successfully. Nov 06 10:51:40 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012" returned: 0 in 0.369s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Lock "cinder-quobyte-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012" released by "delete_volume" :: held 0.948s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Flow 'volume_create_manager' (d7b66eaa-4566-4748-9717-1d614aa70a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e995e8f-d8d5-4b0b-bae1-791fa34e34a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e995e8f-d8d5-4b0b-bae1-791fa34e34a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-173353777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da03606-8cff-420a-9925-6b9911bd03bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8637a921fbd14f039c229a881a7a2fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:40Z,use_quota=True,user_id='83ea29e12c1747b4b4b278e9a2f5e258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6696d43c-ef67-4009-b563-454753adac3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6696d43c-ef67-4009-b563-454753adac3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0737ba1-64f8-40c8-8edf-08bf23a78a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0737ba1-64f8-40c8-8edf-08bf23a78a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da03606-8cff-420a-9925-6b9911bd03bf', 'volume_name': 'volume-6da03606-8cff-420a-9925-6b9911bd03bf', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3a2af0-a986-43b9-a1bb-2670cdf071a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3a2af0-a986-43b9-a1bb-2670cdf071a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a49c2e6-9a32-4da8-b117-ca42f39a577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:40 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume 6da03606-8cff-420a-9925-6b9911bd03bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da03606-8cff-420a-9925-6b9911bd03bf', 'volume_size': 1} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-173353777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da03606-8cff-420a-9925-6b9911bd03bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8637a921fbd14f039c229a881a7a2fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:40Z,use_quota=True,user_id='83ea29e12c1747b4b4b278e9a2f5e258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Creating volume 6da03606-8cff-420a-9925-6b9911bd03bf {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:40 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6da03606-8cff-420a-9925-6b9911bd03bf 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:40 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6da03606-8cff-420a-9925-6b9911bd03bf 1073741824 Nov 06 10:51:40 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Created reservations ['b94d311e-ee29-42a5-8cab-6ba02b118562', 'dcc425cc-4fd4-43ff-afec-fb3f71094bf3', 'ff652f9f-f706-4b2e-9a70-04e615c1b112', 'abf51e72-25a9-41aa-9f39-27b3665cd297'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:40 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:40 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Flow 'volume_create_manager' (3a79bf6c-7f4a-492d-843d-9a2fc8aebcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacd47b6-46a7-4b19-b06f-115245214e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacd47b6-46a7-4b19-b06f-115245214e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1138654225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcb10bc-cfd3-45aa-a345-ad1f48a41907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8637a921fbd14f039c229a881a7a2fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:41Z,use_quota=True,user_id='83ea29e12c1747b4b4b278e9a2f5e258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91d0947-2b96-48c8-ad45-e6deaea5e480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91d0947-2b96-48c8-ad45-e6deaea5e480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7eb1337-6799-43d3-85ac-aea120c17a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7eb1337-6799-43d3-85ac-aea120c17a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fcb10bc-cfd3-45aa-a345-ad1f48a41907', 'volume_name': 'volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f912fceb-bc14-4073-98fc-06babdde45cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f912fceb-bc14-4073-98fc-06babdde45cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891b20a9-19e7-4919-93b4-b234adf7a6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:40 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume 6fcb10bc-cfd3-45aa-a345-ad1f48a41907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907', 'volume_size': 1} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:40 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.379s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:40 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Deleted volume successfully. Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8580d646-a6e5-42a7-a45a-8b0ecbab80cd tempest-VolumesTransfersTest-1610145378 None] Lock "cinder-d0ae4d1d-7ed9-4be7-bb2d-2757a8e1e012-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:40 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6da03606-8cff-420a-9925-6b9911bd03bf 1073741824" returned: 0 in 0.741s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6da03606-8cff-420a-9925-6b9911bd03bf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:41 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6da03606-8cff-420a-9925-6b9911bd03bf Nov 06 10:51:41 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Flow 'volume_create_manager' (1fd0ee75-679c-42c8-bf91-ecbedd0f1f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a14162c-17e6-4b86-a232-bcb0dd8eeec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a14162c-17e6-4b86-a232-bcb0dd8eeec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1483225621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b942beb-980a-4f27-8e0a-c26c8db692d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8637a921fbd14f039c229a881a7a2fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:41Z,use_quota=True,user_id='83ea29e12c1747b4b4b278e9a2f5e258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5510009b-53d4-4486-b254-356e1a1aacb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5510009b-53d4-4486-b254-356e1a1aacb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac6754e-5345-4547-9972-a979e75c517f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac6754e-5345-4547-9972-a979e75c517f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b942beb-980a-4f27-8e0a-c26c8db692d3', 'volume_name': 'volume-4b942beb-980a-4f27-8e0a-c26c8db692d3', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0192acfe-d344-4b96-861f-52a9ec722df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0192acfe-d344-4b96-861f-52a9ec722df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a718051c-37f3-4d72-8282-03a4fe55f218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:41 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume 4b942beb-980a-4f27-8e0a-c26c8db692d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b942beb-980a-4f27-8e0a-c26c8db692d3', 'volume_size': 1} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:41 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6da03606-8cff-420a-9925-6b9911bd03bf" returned: 0 in 0.358s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1138654225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcb10bc-cfd3-45aa-a345-ad1f48a41907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8637a921fbd14f039c229a881a7a2fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:41Z,use_quota=True,user_id='83ea29e12c1747b4b4b278e9a2f5e258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Creating volume 6fcb10bc-cfd3-45aa-a345-ad1f48a41907 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:41 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a49c2e6-9a32-4da8-b117-ca42f39a577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da03606-8cff-420a-9925-6b9911bd03bf', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d12846-c5a3-459e-909e-f777e8a9befa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:41 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907 1073741824 Nov 06 10:51:41 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:41 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume volume-6da03606-8cff-420a-9925-6b9911bd03bf (6da03606-8cff-420a-9925-6b9911bd03bf): created successfully Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d12846-c5a3-459e-909e-f777e8a9befa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Flow 'volume_create_manager' (d7b66eaa-4566-4748-9717-1d614aa70a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:41 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-eb242e72-9fc2-4b4d-b763-fe46d94ea073 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Created volume successfully. Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Flow 'volume_create_manager' (5ec2ffae-5b50-4c07-80ec-89369852c084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a30335d-e592-4662-ad69-6e29bc7345eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a30335d-e592-4662-ad69-6e29bc7345eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574820994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b6f75c-d323-4da3-8066-1461802cc9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8637a921fbd14f039c229a881a7a2fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:42Z,use_quota=True,user_id='83ea29e12c1747b4b4b278e9a2f5e258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a60af2-74cb-44ce-9072-43f22011d6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a60af2-74cb-44ce-9072-43f22011d6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b6e808-d944-4dcd-bbdb-ffa99476d43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b6e808-d944-4dcd-bbdb-ffa99476d43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4b6f75c-d323-4da3-8066-1461802cc9b3', 'volume_name': 'volume-c4b6f75c-d323-4da3-8066-1461802cc9b3', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d265ef-1268-44e5-bf3e-a81b52b39903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d265ef-1268-44e5-bf3e-a81b52b39903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9ea0c0-3216-4e16-9f76-84adc5fc9af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:41 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume c4b6f75c-d323-4da3-8066-1461802cc9b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4b6f75c-d323-4da3-8066-1461802cc9b3', 'volume_size': 1} Nov 06 10:51:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:42 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-fd0de598-242d-4410-9c43-02f74805ae9d tempest-VolumesTransfersV355Test-971059178 None] Transfer volume completed successfully. Nov 06 10:51:42 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907 1073741824" returned: 0 in 0.713s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:42 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907 Nov 06 10:51:42 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Flow 'volume_create_manager' (31334a0f-5c54-49b9-8695-be3e320be970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff230595-69e2-46a0-8f25-f801069c66e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff230595-69e2-46a0-8f25-f801069c66e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2027101438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f867f1bc-1010-4c27-80a5-aae517502c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8637a921fbd14f039c229a881a7a2fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:42Z,use_quota=True,user_id='83ea29e12c1747b4b4b278e9a2f5e258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb3cb3d-5e0a-4c92-92eb-ec29b8884ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb3cb3d-5e0a-4c92-92eb-ec29b8884ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3df5ed7-18a5-4704-8d0e-ebae67a32b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3df5ed7-18a5-4704-8d0e-ebae67a32b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f867f1bc-1010-4c27-80a5-aae517502c0f', 'volume_name': 'volume-f867f1bc-1010-4c27-80a5-aae517502c0f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b36fcf2-ab58-4682-b0c4-44e1f9a0aacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b36fcf2-ab58-4682-b0c4-44e1f9a0aacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075a2095-63a7-4d27-a1e9-c7adab1a2eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:42 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume f867f1bc-1010-4c27-80a5-aae517502c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f867f1bc-1010-4c27-80a5-aae517502c0f', 'volume_size': 1} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:42 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907" returned: 0 in 0.325s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.113s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1483225621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b942beb-980a-4f27-8e0a-c26c8db692d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8637a921fbd14f039c229a881a7a2fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:41Z,use_quota=True,user_id='83ea29e12c1747b4b4b278e9a2f5e258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Creating volume 4b942beb-980a-4f27-8e0a-c26c8db692d3 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:42 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4b942beb-980a-4f27-8e0a-c26c8db692d3 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891b20a9-19e7-4919-93b4-b234adf7a6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbc9fb3-e281-48ba-9377-21a52cde3095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:42 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4b942beb-980a-4f27-8e0a-c26c8db692d3 1073741824 Nov 06 10:51:42 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:42 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907 (6fcb10bc-cfd3-45aa-a345-ad1f48a41907): created successfully Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbc9fb3-e281-48ba-9377-21a52cde3095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Flow 'volume_create_manager' (3a79bf6c-7f4a-492d-843d-9a2fc8aebcc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:42 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d22fd9ac-20d4-4213-b323-8692d6790ba1 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Created volume successfully. Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Acquiring lock "cinder-76c300e7-312f-4286-bff4-c40796b28cc7-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Lock "cinder-76c300e7-312f-4286-bff4-c40796b28cc7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Flow 'volume_create_manager' (c6c17502-51ae-4a49-9234-c37cc9cae645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222d5e2d-ea3a-410c-9651-60c89f1bad11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Acquiring lock "cinder-quobyte-76c300e7-312f-4286-bff4-c40796b28cc7" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222d5e2d-ea3a-410c-9651-60c89f1bad11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1763958022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19104109-4edd-4c0e-aa8d-83f03bdcf5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0867cbb0e2d64690baebabe055d1cb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:43Z,use_quota=True,user_id='52bc3eff69cf4f709b181d80eb3b6932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4eb6307-02ad-45a0-b2da-c53a95e4b0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4eb6307-02ad-45a0-b2da-c53a95e4b0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbc8a0d-fce3-4692-bf4c-06691805e8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbc8a0d-fce3-4692-bf4c-06691805e8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19104109-4edd-4c0e-aa8d-83f03bdcf5bb', 'volume_name': 'volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc6c534-f39a-4350-91a1-599ce7ae6fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc6c534-f39a-4350-91a1-599ce7ae6fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8452c3-f8f5-4fe8-9ab2-ae0100e99e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:42 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Volume 19104109-4edd-4c0e-aa8d-83f03bdcf5bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb', 'volume_size': 1} Nov 06 10:51:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Lock "cinder-quobyte-76c300e7-312f-4286-bff4-c40796b28cc7" acquired by "delete_volume" :: waited 0.082s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1310bc35-c464-4e55-9ba3-87327a68f5bd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-76c300e7-312f-4286-bff4-c40796b28cc7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:43 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4b942beb-980a-4f27-8e0a-c26c8db692d3 1073741824" returned: 0 in 0.673s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:43 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-76c300e7-312f-4286-bff4-c40796b28cc7 Nov 06 10:51:43 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4b942beb-980a-4f27-8e0a-c26c8db692d3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:43 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4b942beb-980a-4f27-8e0a-c26c8db692d3 Nov 06 10:51:43 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:43 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-76c300e7-312f-4286-bff4-c40796b28cc7" returned: 0 in 0.444s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-76c300e7-312f-4286-bff4-c40796b28cc7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:43 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-76c300e7-312f-4286-bff4-c40796b28cc7 Nov 06 10:51:43 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:43 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4b942beb-980a-4f27-8e0a-c26c8db692d3" returned: 0 in 0.306s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.605s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574820994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b6f75c-d323-4da3-8066-1461802cc9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8637a921fbd14f039c229a881a7a2fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:42Z,use_quota=True,user_id='83ea29e12c1747b4b4b278e9a2f5e258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Creating volume c4b6f75c-d323-4da3-8066-1461802cc9b3 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:43 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c4b6f75c-d323-4da3-8066-1461802cc9b3 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a718051c-37f3-4d72-8282-03a4fe55f218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b942beb-980a-4f27-8e0a-c26c8db692d3', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:43 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c4b6f75c-d323-4da3-8066-1461802cc9b3 1073741824 Nov 06 10:51:43 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23f2e97-a210-41bb-9a8f-21eebf55964a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:43 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume volume-4b942beb-980a-4f27-8e0a-c26c8db692d3 (4b942beb-980a-4f27-8e0a-c26c8db692d3): created successfully Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23f2e97-a210-41bb-9a8f-21eebf55964a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Flow 'volume_create_manager' (1fd0ee75-679c-42c8-bf91-ecbedd0f1f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:43 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9c5233e3-f42e-45a2-8e0f-62b839cc1c7b tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Created volume successfully. Nov 06 10:51:43 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-76c300e7-312f-4286-bff4-c40796b28cc7" returned: 0 in 0.355s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Lock "cinder-quobyte-76c300e7-312f-4286-bff4-c40796b28cc7" released by "delete_volume" :: held 0.856s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Created reservations ['9dc9fdbf-095a-4360-b77f-f5ddb9bf1577', 'b3a3c3c6-8696-44fa-99f9-d24010a8197a', '6467937f-b862-4a51-834f-5b83212326c8', 'a8aa6928-7128-4ba8-9ea4-511992ea4ccc'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:44 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:44 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:44 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c4b6f75c-d323-4da3-8066-1461802cc9b3 1073741824" returned: 0 in 0.584s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c4b6f75c-d323-4da3-8066-1461802cc9b3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:44 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c4b6f75c-d323-4da3-8066-1461802cc9b3 Nov 06 10:51:44 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:44 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.289s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:44 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Deleted volume successfully. Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-bd7f21d7-b72d-465a-9ff6-41e166ed7fe4 tempest-VolumesTransfersV355Test-439690159 None] Lock "cinder-76c300e7-312f-4286-bff4-c40796b28cc7-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:44 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c4b6f75c-d323-4da3-8066-1461802cc9b3" returned: 0 in 0.280s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.099s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2027101438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f867f1bc-1010-4c27-80a5-aae517502c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8637a921fbd14f039c229a881a7a2fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:42Z,use_quota=True,user_id='83ea29e12c1747b4b4b278e9a2f5e258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Creating volume f867f1bc-1010-4c27-80a5-aae517502c0f {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:44 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f867f1bc-1010-4c27-80a5-aae517502c0f 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9ea0c0-3216-4e16-9f76-84adc5fc9af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4b6f75c-d323-4da3-8066-1461802cc9b3', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:44 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f867f1bc-1010-4c27-80a5-aae517502c0f 1073741824 Nov 06 10:51:44 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441648ba-d11d-4bd4-989c-67cdbeb8ded6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:44 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume volume-c4b6f75c-d323-4da3-8066-1461802cc9b3 (c4b6f75c-d323-4da3-8066-1461802cc9b3): created successfully Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441648ba-d11d-4bd4-989c-67cdbeb8ded6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Flow 'volume_create_manager' (5ec2ffae-5b50-4c07-80ec-89369852c084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:44 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-50a0424f-027a-4c27-9968-620c03386510 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Created volume successfully. Nov 06 10:51:44 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f867f1bc-1010-4c27-80a5-aae517502c0f 1073741824" returned: 0 in 0.462s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f867f1bc-1010-4c27-80a5-aae517502c0f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:44 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f867f1bc-1010-4c27-80a5-aae517502c0f Nov 06 10:51:44 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:45 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f867f1bc-1010-4c27-80a5-aae517502c0f" returned: 0 in 0.260s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.247s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1763958022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19104109-4edd-4c0e-aa8d-83f03bdcf5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0867cbb0e2d64690baebabe055d1cb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:43Z,use_quota=True,user_id='52bc3eff69cf4f709b181d80eb3b6932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Creating volume 19104109-4edd-4c0e-aa8d-83f03bdcf5bb {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:45 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075a2095-63a7-4d27-a1e9-c7adab1a2eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f867f1bc-1010-4c27-80a5-aae517502c0f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76966098-36ce-4dfd-afc8-4c77e13b87f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:45 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb 1073741824 Nov 06 10:51:45 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:45 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Volume volume-f867f1bc-1010-4c27-80a5-aae517502c0f (f867f1bc-1010-4c27-80a5-aae517502c0f): created successfully Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76966098-36ce-4dfd-afc8-4c77e13b87f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Flow 'volume_create_manager' (31334a0f-5c54-49b9-8695-be3e320be970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:45 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-fb37d654-5a00-45ca-9d17-a0dc252f8971 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Created volume successfully. Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "cinder-f867f1bc-1010-4c27-80a5-aae517502c0f-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Flow 'volume_create_manager' (f22ab7fd-2e56-4094-8fab-0631780e9d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021d34c8-085c-4010-8a5d-e6b93de35fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-f867f1bc-1010-4c27-80a5-aae517502c0f-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021d34c8-085c-4010-8a5d-e6b93de35fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-782167594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0661b1b6-7a09-4f3b-b915-3d44d8822a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabec1d4685c49d1afa0aca6ad032f1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:46Z,use_quota=True,user_id='9b12df0869234242ac3befc64bfdda36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1fdedd-6800-4e24-9d41-d63dc6b25c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1fdedd-6800-4e24-9d41-d63dc6b25c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a27aabc-9d46-4455-ac7b-90b403847a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a27aabc-9d46-4455-ac7b-90b403847a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0661b1b6-7a09-4f3b-b915-3d44d8822a03', 'volume_name': 'volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7b8470-49bb-4ced-a7a3-1ccb06fad49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7b8470-49bb-4ced-a7a3-1ccb06fad49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37da9afc-1320-4484-8297-c877426e0b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:45 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Volume 0661b1b6-7a09-4f3b-b915-3d44d8822a03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03', 'volume_size': 1} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "cinder-quobyte-f867f1bc-1010-4c27-80a5-aae517502c0f" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-quobyte-f867f1bc-1010-4c27-80a5-aae517502c0f" acquired by "delete_volume" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:45 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb 1073741824" returned: 0 in 0.695s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7320da37-0ddc-4230-b985-a9f958a21229]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f867f1bc-1010-4c27-80a5-aae517502c0f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:46 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb Nov 06 10:51:46 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:46 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f867f1bc-1010-4c27-80a5-aae517502c0f Nov 06 10:51:46 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:46 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb" returned: 0 in 0.255s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.363s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-782167594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0661b1b6-7a09-4f3b-b915-3d44d8822a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabec1d4685c49d1afa0aca6ad032f1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:46Z,use_quota=True,user_id='9b12df0869234242ac3befc64bfdda36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Creating volume 0661b1b6-7a09-4f3b-b915-3d44d8822a03 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:46 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8452c3-f8f5-4fe8-9ab2-ae0100e99e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:46 devstack sudo[102074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03 1073741824 Nov 06 10:51:46 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6535d6-6ce6-46dc-a3fb-861121dd7724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:46 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Volume volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb (19104109-4edd-4c0e-aa8d-83f03bdcf5bb): created successfully Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6535d6-6ce6-46dc-a3fb-861121dd7724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Flow 'volume_create_manager' (c6c17502-51ae-4a49-9234-c37cc9cae645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:46 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-8a3fbe2f-e8bd-448d-a414-e4a4bad8f6e7 tempest-VolumesTransfersTest-1643067444 None] Created volume successfully. Nov 06 10:51:46 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f867f1bc-1010-4c27-80a5-aae517502c0f" returned: 0 in 0.435s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f867f1bc-1010-4c27-80a5-aae517502c0f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:46 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f867f1bc-1010-4c27-80a5-aae517502c0f Nov 06 10:51:46 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:46 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f867f1bc-1010-4c27-80a5-aae517502c0f" returned: 0 in 0.289s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-quobyte-f867f1bc-1010-4c27-80a5-aae517502c0f" released by "delete_volume" :: held 0.773s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Created reservations ['36d43577-0ade-4fc9-a194-b88e9c232550', 'a338b561-dc63-4cfb-a0d0-05123e377c1f', '38873c3a-37a9-4998-8d45-62794c12593f', '874d7f79-f506-4224-a65f-7a301b047f4e'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:46 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03 1073741824" returned: 0 in 0.512s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:46 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03 Nov 06 10:51:46 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:46 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:46 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "cinder-c4b6f75c-d323-4da3-8066-1461802cc9b3-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-c4b6f75c-d323-4da3-8066-1461802cc9b3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "cinder-quobyte-c4b6f75c-d323-4da3-8066-1461802cc9b3" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-quobyte-c4b6f75c-d323-4da3-8066-1461802cc9b3" acquired by "delete_volume" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63d33ce-1aaa-42e0-b552-a9d79c42e528]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c4b6f75c-d323-4da3-8066-1461802cc9b3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:47 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03" returned: 0 in 0.300s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37da9afc-1320-4484-8297-c877426e0b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dce6024-c364-4b45-ad1a-746dfb81a211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:47 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Volume volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03 (0661b1b6-7a09-4f3b-b915-3d44d8822a03): created successfully Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dce6024-c364-4b45-ad1a-746dfb81a211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Flow 'volume_create_manager' (f22ab7fd-2e56-4094-8fab-0631780e9d05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:47 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-af14556c-e4af-4a30-863c-c40daa7e5347 tempest-VolumesTransfersV355Test-653242116 None] Created volume successfully. Nov 06 10:51:47 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c4b6f75c-d323-4da3-8066-1461802cc9b3 Nov 06 10:51:47 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:47 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.417s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:47 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Deleted volume successfully. Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-16a465a0-d525-494e-932e-1427e5338cd8 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-f867f1bc-1010-4c27-80a5-aae517502c0f-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Acquiring lock "cinder-19104109-4edd-4c0e-aa8d-83f03bdcf5bb-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Lock "cinder-19104109-4edd-4c0e-aa8d-83f03bdcf5bb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Acquiring lock "cinder-quobyte-19104109-4edd-4c0e-aa8d-83f03bdcf5bb" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Lock "cinder-quobyte-19104109-4edd-4c0e-aa8d-83f03bdcf5bb" acquired by "delete_volume" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5457502f-cb63-4bec-8138-5d3fd960b393]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:47 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c4b6f75c-d323-4da3-8066-1461802cc9b3" returned: 0 in 0.552s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c4b6f75c-d323-4da3-8066-1461802cc9b3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:47 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c4b6f75c-d323-4da3-8066-1461802cc9b3 Nov 06 10:51:47 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:47 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb Nov 06 10:51:47 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:47 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c4b6f75c-d323-4da3-8066-1461802cc9b3" returned: 0 in 0.321s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:47 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb" returned: 0 in 0.416s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-quobyte-c4b6f75c-d323-4da3-8066-1461802cc9b3" released by "delete_volume" :: held 0.945s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:48 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb Nov 06 10:51:48 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Created reservations ['2a5e30d1-c06c-4bd1-a827-59fdd5b407de', '3bcfb459-7e94-4fd9-bdec-cca9d0fa71cc', 'b93e1baf-e411-4156-b3b8-3889ac9baa78', 'dcfbeb6c-3fd4-4263-9e88-a28dc27a04e6'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Acquiring lock "cinder-0661b1b6-7a09-4f3b-b915-3d44d8822a03-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Lock "cinder-0661b1b6-7a09-4f3b-b915-3d44d8822a03-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:48 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:48 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Acquiring lock "cinder-quobyte-0661b1b6-7a09-4f3b-b915-3d44d8822a03" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Lock "cinder-quobyte-0661b1b6-7a09-4f3b-b915-3d44d8822a03" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:48 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-19104109-4edd-4c0e-aa8d-83f03bdcf5bb" returned: 0 in 0.364s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Lock "cinder-quobyte-19104109-4edd-4c0e-aa8d-83f03bdcf5bb" released by "delete_volume" :: held 0.841s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca95f70e-6b69-432c-a559-6e3b21e23347]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Created reservations ['63bf3023-6e8e-4fb3-ab8c-2a1ff8db8fae', 'da72512c-cd58-4cae-8eb2-b9b934eb1cd1', 'da930e1e-525b-452c-ae9d-c16889fe6737', '9cd9780d-6add-469d-82e7-760cf2fe66a1'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:48 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03 Nov 06 10:51:48 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:48 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:48 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.413s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:48 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:48 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Deleted volume successfully. Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-653697a5-0957-4179-9b93-ddc850ac4c52 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-c4b6f75c-d323-4da3-8066-1461802cc9b3-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:48 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.329s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:48 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Deleted volume successfully. Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e8b01b49-2f03-4bc8-8c88-b85c253d6d9c tempest-VolumesTransfersTest-1610145378 None] Lock "cinder-19104109-4edd-4c0e-aa8d-83f03bdcf5bb-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:48 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03" returned: 0 in 0.540s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:48 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03 Nov 06 10:51:48 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:49 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0661b1b6-7a09-4f3b-b915-3d44d8822a03" returned: 0 in 0.323s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "cinder-4b942beb-980a-4f27-8e0a-c26c8db692d3-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Lock "cinder-quobyte-0661b1b6-7a09-4f3b-b915-3d44d8822a03" released by "delete_volume" :: held 0.962s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-4b942beb-980a-4f27-8e0a-c26c8db692d3-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "cinder-quobyte-4b942beb-980a-4f27-8e0a-c26c8db692d3" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Created reservations ['8447b14d-e4d8-49b0-9c07-81dc89628ed5', 'adb597ed-8d5a-4798-9806-a621a69f2fa4', '13779141-f21f-425e-859a-76537fec69fb', 'cd1b9534-9250-43b4-8b9d-397ad9d3ab10'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-quobyte-4b942beb-980a-4f27-8e0a-c26c8db692d3" acquired by "delete_volume" :: waited 0.032s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9359c8-fe56-470e-beea-43672e3e9d68]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4b942beb-980a-4f27-8e0a-c26c8db692d3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:49 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:49 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:49 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4b942beb-980a-4f27-8e0a-c26c8db692d3 Nov 06 10:51:49 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:49 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.304s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:49 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Deleted volume successfully. Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1b660d98-8c2a-4cc3-b347-ebb56afca234 tempest-VolumesTransfersV355Test-439690159 None] Lock "cinder-0661b1b6-7a09-4f3b-b915-3d44d8822a03-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:49 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4b942beb-980a-4f27-8e0a-c26c8db692d3" returned: 0 in 0.475s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4b942beb-980a-4f27-8e0a-c26c8db692d3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:50 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4b942beb-980a-4f27-8e0a-c26c8db692d3 Nov 06 10:51:50 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:50 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4b942beb-980a-4f27-8e0a-c26c8db692d3" returned: 0 in 0.276s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-quobyte-4b942beb-980a-4f27-8e0a-c26c8db692d3" released by "delete_volume" :: held 0.821s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Created reservations ['a6ce0a7b-df29-40aa-9153-3516be489070', '19f5efcd-be8d-46af-bd96-8bcc4957fa2a', 'cbdf4465-9d07-40aa-9079-1fb9f4032378', '7a418056-a32d-40b1-9bec-f411cea7a0c1'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:50 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:50 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "cinder-6fcb10bc-cfd3-45aa-a345-ad1f48a41907-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-6fcb10bc-cfd3-45aa-a345-ad1f48a41907-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "cinder-quobyte-6fcb10bc-cfd3-45aa-a345-ad1f48a41907" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-quobyte-6fcb10bc-cfd3-45aa-a345-ad1f48a41907" acquired by "delete_volume" :: waited 0.037s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[900bc1c0-92b5-4419-be22-ce5a5a6f8e5a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:50 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.405s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:50 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Deleted volume successfully. Nov 06 10:51:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-63ac71d8-3c2e-4856-bee0-99acfcc83347 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-4b942beb-980a-4f27-8e0a-c26c8db692d3-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:50 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907 Nov 06 10:51:50 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:51 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907" returned: 0 in 0.615s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:51 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907 Nov 06 10:51:51 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:51 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6fcb10bc-cfd3-45aa-a345-ad1f48a41907" returned: 0 in 0.362s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-quobyte-6fcb10bc-cfd3-45aa-a345-ad1f48a41907" released by "delete_volume" :: held 1.055s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:51 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Created reservations ['98bca8f5-e472-43c9-9b8b-c0f4f724ef19', 'b28e1793-3e11-4906-949b-26d6a7381d02', '89f57453-8e3b-4939-b40d-03bffcc0272f', '4059ff59-d961-4c99-88c7-cb5224dcc809'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:51 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:51 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:52 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.256s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:52 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:52 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Deleted volume successfully. Nov 06 10:51:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3f820e1d-4fd4-472a-834d-3c66525c10f7 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-6fcb10bc-cfd3-45aa-a345-ad1f48a41907-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "cinder-6da03606-8cff-420a-9925-6b9911bd03bf-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-6da03606-8cff-420a-9925-6b9911bd03bf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "cinder-quobyte-6da03606-8cff-420a-9925-6b9911bd03bf" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-quobyte-6da03606-8cff-420a-9925-6b9911bd03bf" acquired by "delete_volume" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:52 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53c64ff-b2b5-4a85-aff6-aa68988f2063]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6da03606-8cff-420a-9925-6b9911bd03bf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:53 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6da03606-8cff-420a-9925-6b9911bd03bf Nov 06 10:51:53 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:53 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6da03606-8cff-420a-9925-6b9911bd03bf" returned: 0 in 0.497s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6da03606-8cff-420a-9925-6b9911bd03bf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:53 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6da03606-8cff-420a-9925-6b9911bd03bf Nov 06 10:51:53 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Flow 'volume_create_manager' (cfe551d3-dd46-460b-9650-7ccad6d6f9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f927255-c99a-4fdd-9ab2-8b195c83475d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f927255-c99a-4fdd-9ab2-8b195c83475d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-362391978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57ab25a-e733-4ec3-b315-8062203ac9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d2edca1ee7497b8f4e73174c724884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:54Z,use_quota=True,user_id='0e315dfc8ae44170b23368237e4c982b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb351658-38f8-4548-8aea-6e6b813a68dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb351658-38f8-4548-8aea-6e6b813a68dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a162d571-68e7-43b8-9111-aaec78786fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a162d571-68e7-43b8-9111-aaec78786fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a57ab25a-e733-4ec3-b315-8062203ac9f1', 'volume_name': 'volume-a57ab25a-e733-4ec3-b315-8062203ac9f1', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:53 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc76166-bd6f-4efb-b0d0-28b8d42c1123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc76166-bd6f-4efb-b0d0-28b8d42c1123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e411b77a-31fe-4c3f-ba0a-3049b1830610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:53 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume a57ab25a-e733-4ec3-b315-8062203ac9f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a57ab25a-e733-4ec3-b315-8062203ac9f1', 'volume_size': 1} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-362391978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57ab25a-e733-4ec3-b315-8062203ac9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d2edca1ee7497b8f4e73174c724884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:54Z,use_quota=True,user_id='0e315dfc8ae44170b23368237e4c982b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Creating volume a57ab25a-e733-4ec3-b315-8062203ac9f1 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:53 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6da03606-8cff-420a-9925-6b9911bd03bf" returned: 0 in 0.410s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:53 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 1073741824 Nov 06 10:51:53 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-quobyte-6da03606-8cff-420a-9925-6b9911bd03bf" released by "delete_volume" :: held 0.963s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Created reservations ['b44f12da-2963-423e-8fb2-1eb5590bec55', '3e8f9e79-3f62-4569-aa25-e91286b0f5ca', 'c7780174-dd85-45d8-8294-0072d90acce1', 'd6c76ae6-0a9c-4a5a-98b6-a5c898a9c8f8'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:54 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:54 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:54 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.337s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:54 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Deleted volume successfully. Nov 06 10:51:54 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 1073741824" returned: 0 in 0.642s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9e80d047-46c8-44ae-b660-db60aacefb17 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-6da03606-8cff-420a-9925-6b9911bd03bf-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:54 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 Nov 06 10:51:54 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:54 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1" returned: 0 in 0.293s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e411b77a-31fe-4c3f-ba0a-3049b1830610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a57ab25a-e733-4ec3-b315-8062203ac9f1', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85203a4-ba49-4dbe-aba1-73c57cd520aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:54 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 (a57ab25a-e733-4ec3-b315-8062203ac9f1): created successfully Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85203a4-ba49-4dbe-aba1-73c57cd520aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Flow 'volume_create_manager' (cfe551d3-dd46-460b-9650-7ccad6d6f9eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:54 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-538290d3-473d-4da2-a737-1bdce37ea46c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Created volume successfully. Nov 06 10:51:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "cinder-001ca509-eecf-4de7-a30b-ad0337b3daa5-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-001ca509-eecf-4de7-a30b-ad0337b3daa5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "cinder-quobyte-001ca509-eecf-4de7-a30b-ad0337b3daa5" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:51:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-quobyte-001ca509-eecf-4de7-a30b-ad0337b3daa5" acquired by "delete_volume" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:51:55 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6dac61-508c-40e7-9399-e481931c26a0]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-001ca509-eecf-4de7-a30b-ad0337b3daa5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:55 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-001ca509-eecf-4de7-a30b-ad0337b3daa5 Nov 06 10:51:55 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:55 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-001ca509-eecf-4de7-a30b-ad0337b3daa5" returned: 0 in 0.512s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-001ca509-eecf-4de7-a30b-ad0337b3daa5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:55 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-001ca509-eecf-4de7-a30b-ad0337b3daa5 Nov 06 10:51:55 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Creating offline snapshot 19bc8e0e-e9fd-4922-ade5-94d4ccef0817 of volume a57ab25a-e733-4ec3-b315-8062203ac9f1 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[83154cc6-237f-42bf-b7ee-6a2c062f2f6b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:56 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-001ca509-eecf-4de7-a30b-ad0337b3daa5" returned: 0 in 0.388s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-quobyte-001ca509-eecf-4de7-a30b-ad0337b3daa5" released by "delete_volume" :: held 0.979s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:56 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 Nov 06 10:51:56 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Created reservations ['0f1034f9-2b3d-483d-abae-75a978e5fcb4', '320c10fd-de9e-4784-9644-f5a2071ad583', '9417f7eb-619c-4638-97ae-9e0dad69f638', '3436388e-b80c-4203-a9f5-17cc8f61371e'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:56 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:51:56 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:56 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1" returned: 0 in 0.513s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:56 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817 1G Nov 06 10:51:56 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:56 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.280s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:51:56 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Deleted volume successfully. Nov 06 10:51:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3e0d13f7-2481-4148-b945-55c04fb9be72 tempest-CreateVolumesFromSourceVolumeTest-964905545 None] Lock "cinder-001ca509-eecf-4de7-a30b-ad0337b3daa5-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:51:57 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817 1G" returned: 0 in 0.490s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:57 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817 Nov 06 10:51:57 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:57 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817" returned: 0 in 0.424s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:57 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817 is being set with open permissions: ugo+rw Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:57 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817 Nov 06 10:51:57 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Flow 'volume_create_manager' (ad198e81-baad-489b-b939-d881794e0f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914da099-aad4-47fd-87b6-90a471c18e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914da099-aad4-47fd-87b6-90a471c18e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1487045837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fea3de-0609-41b0-8316-9199d49d472f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='29efbffb1c434d84a3712be762000a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:58Z,use_quota=True,user_id='50c72d45cb084afd9b2a3171dee31a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730abd15-3450-42dd-a95e-058239686779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730abd15-3450-42dd-a95e-058239686779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d9bc73-bf31-4012-a1ea-ce28b4539059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d9bc73-bf31-4012-a1ea-ce28b4539059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92fea3de-0609-41b0-8316-9199d49d472f', 'volume_name': 'volume-92fea3de-0609-41b0-8316-9199d49d472f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aed74e0-1b69-4208-bd9c-976d9dfdab32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aed74e0-1b69-4208-bd9c-976d9dfdab32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45718a28-d07b-44ca-9a80-d39a1c2325ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:57 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Volume 92fea3de-0609-41b0-8316-9199d49d472f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92fea3de-0609-41b0-8316-9199d49d472f', 'volume_size': 1} Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:57 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817" returned: 0 in 0.330s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:57 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.info Nov 06 10:51:57 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:58 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.info" returned: 0 in 0.277s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:58 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.info is being set with open permissions: ugo+rw Nov 06 10:51:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:58 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.info Nov 06 10:51:58 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:58 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.info" returned: 0 in 0.278s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.647s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1487045837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fea3de-0609-41b0-8316-9199d49d472f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='29efbffb1c434d84a3712be762000a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:51:58Z,use_quota=True,user_id='50c72d45cb084afd9b2a3171dee31a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:51:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Creating volume 92fea3de-0609-41b0-8316-9199d49d472f {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:51:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:51:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:51:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:51:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:51:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:51:58 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:51:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-92fea3de-0609-41b0-8316-9199d49d472f 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:58 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-92fea3de-0609-41b0-8316-9199d49d472f 1073741824 Nov 06 10:51:58 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:58 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-cd5166d1-ae89-4c58-8203-b4f44886a9a9 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Create snapshot completed successfully Nov 06 10:51:59 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-92fea3de-0609-41b0-8316-9199d49d472f 1073741824" returned: 0 in 0.578s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-92fea3de-0609-41b0-8316-9199d49d472f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:51:59 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-92fea3de-0609-41b0-8316-9199d49d472f Nov 06 10:51:59 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:51:59 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Nov 06 10:51:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-92fea3de-0609-41b0-8316-9199d49d472f" returned: 0 in 0.290s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:51:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:51:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:51:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45718a28-d07b-44ca-9a80-d39a1c2325ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92fea3de-0609-41b0-8316-9199d49d472f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea7bb5f-a9b9-4a28-911b-8245b70c8baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:59 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Volume volume-92fea3de-0609-41b0-8316-9199d49d472f (92fea3de-0609-41b0-8316-9199d49d472f): created successfully Nov 06 10:51:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea7bb5f-a9b9-4a28-911b-8245b70c8baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Flow 'volume_create_manager' (ad198e81-baad-489b-b939-d881794e0f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:59 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-3366a118-b52f-4aeb-8a41-081c65bb876b tempest-VolumesGetTest-2022055069 None] Created volume successfully. Nov 06 10:51:59 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:51:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Flow 'volume_create_manager' (be3a1dbb-8d9c-4e2f-b69c-955c7d5dd009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:51:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b07c17-75e5-4135-881b-8ece54258965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b07c17-75e5-4135-881b-8ece54258965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1462779162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21901c29-e95d-4120-857c-067901b1f018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d2edca1ee7497b8f4e73174c724884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:00Z,use_quota=True,user_id='0e315dfc8ae44170b23368237e4c982b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:51:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e583f0f-8245-4994-b47a-d86d697faa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:51:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e583f0f-8245-4994-b47a-d86d697faa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330e927e-bf44-464b-ab6a-b69ca3506c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330e927e-bf44-464b-ab6a-b69ca3506c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21901c29-e95d-4120-857c-067901b1f018', 'volume_name': 'volume-21901c29-e95d-4120-857c-067901b1f018', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2f467a-5f76-47b8-b86c-84f51d0be662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2f467a-5f76-47b8-b86c-84f51d0be662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9fd6fbb-5aaf-4dec-9884-ffc3c30288e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:00 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume 21901c29-e95d-4120-857c-067901b1f018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21901c29-e95d-4120-857c-067901b1f018', 'volume_size': 1} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1462779162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21901c29-e95d-4120-857c-067901b1f018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d2edca1ee7497b8f4e73174c724884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:00Z,use_quota=True,user_id='0e315dfc8ae44170b23368237e4c982b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Creating volume 21901c29-e95d-4120-857c-067901b1f018 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:00 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21901c29-e95d-4120-857c-067901b1f018 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:00 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21901c29-e95d-4120-857c-067901b1f018 1073741824 Nov 06 10:52:00 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Flow 'volume_create_manager' (607a3505-9569-4f93-b2f6-9bd7654e12a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61442b5-c7cb-48d3-986f-99a380725e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61442b5-c7cb-48d3-986f-99a380725e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-91993863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38371beb-0aaa-4dd4-aa21-79154956f646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d2edca1ee7497b8f4e73174c724884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:00Z,use_quota=True,user_id='0e315dfc8ae44170b23368237e4c982b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40df2a45-172a-485c-91f8-270f12ad686d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40df2a45-172a-485c-91f8-270f12ad686d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6be1c01-1c96-498f-a9d0-f21ea26bebf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6be1c01-1c96-498f-a9d0-f21ea26bebf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38371beb-0aaa-4dd4-aa21-79154956f646', 'volume_name': 'volume-38371beb-0aaa-4dd4-aa21-79154956f646', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428ce2b2-824b-46a8-b467-7fe7572f535c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428ce2b2-824b-46a8-b467-7fe7572f535c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc81e3b-c40e-40d4-a15b-6944d0748c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:00 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume 38371beb-0aaa-4dd4-aa21-79154956f646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38371beb-0aaa-4dd4-aa21-79154956f646', 'volume_size': 1} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:00 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21901c29-e95d-4120-857c-067901b1f018 1073741824" returned: 0 in 0.773s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21901c29-e95d-4120-857c-067901b1f018 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:00 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21901c29-e95d-4120-857c-067901b1f018 Nov 06 10:52:00 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:01 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21901c29-e95d-4120-857c-067901b1f018" returned: 0 in 0.433s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-91993863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38371beb-0aaa-4dd4-aa21-79154956f646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d2edca1ee7497b8f4e73174c724884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:00Z,use_quota=True,user_id='0e315dfc8ae44170b23368237e4c982b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Creating volume 38371beb-0aaa-4dd4-aa21-79154956f646 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:01 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-38371beb-0aaa-4dd4-aa21-79154956f646 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9fd6fbb-5aaf-4dec-9884-ffc3c30288e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21901c29-e95d-4120-857c-067901b1f018', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c449664e-041c-4c51-8ebf-e741f3403878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:01 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-38371beb-0aaa-4dd4-aa21-79154956f646 1073741824 Nov 06 10:52:01 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:01 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume volume-21901c29-e95d-4120-857c-067901b1f018 (21901c29-e95d-4120-857c-067901b1f018): created successfully Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c449664e-041c-4c51-8ebf-e741f3403878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Flow 'volume_create_manager' (be3a1dbb-8d9c-4e2f-b69c-955c7d5dd009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:01 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a23c1432-b101-4c68-a723-017a9b331258 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Created volume successfully. Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Flow 'volume_create_manager' (37742fdb-5bd7-4ef3-a5a9-f2f2d74344f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4174d7c3-5fc9-4c36-9ebc-39cbf431597a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4174d7c3-5fc9-4c36-9ebc-39cbf431597a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1912406407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d1059d-474d-4610-895b-1c15d2293253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d2edca1ee7497b8f4e73174c724884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:01Z,use_quota=True,user_id='0e315dfc8ae44170b23368237e4c982b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608e365d-c3d4-41d4-bc94-31ca325e0403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608e365d-c3d4-41d4-bc94-31ca325e0403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52a3851-6e42-4dae-a665-72174efa7bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52a3851-6e42-4dae-a665-72174efa7bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d1059d-474d-4610-895b-1c15d2293253', 'volume_name': 'volume-44d1059d-474d-4610-895b-1c15d2293253', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ef76b4-83da-47ff-b5df-91fa4e6a4776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ef76b4-83da-47ff-b5df-91fa4e6a4776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e12a1b1-0fe4-4c3a-8f1a-dc2719cae33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:01 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume 44d1059d-474d-4610-895b-1c15d2293253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d1059d-474d-4610-895b-1c15d2293253', 'volume_size': 1} Nov 06 10:52:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:02 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Flow 'volume_create_manager' (90430713-9ab1-4525-adce-767805cea1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a169a00d-3b2b-42ee-8c3c-9d849919a8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-38371beb-0aaa-4dd4-aa21-79154956f646 1073741824" returned: 0 in 0.724s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a169a00d-3b2b-42ee-8c3c-9d849919a8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1116068315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c0c67f-7644-4c31-8b58-ef28fae289e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d2edca1ee7497b8f4e73174c724884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:02Z,use_quota=True,user_id='0e315dfc8ae44170b23368237e4c982b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8555c19e-5f97-4b62-9715-4e6ec023b3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8555c19e-5f97-4b62-9715-4e6ec023b3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b80792-ee8f-4fba-8eeb-b0f3969c81c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b80792-ee8f-4fba-8eeb-b0f3969c81c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c0c67f-7644-4c31-8b58-ef28fae289e3', 'volume_name': 'volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56f0b08-5e42-4c67-95dc-7ee5de347ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56f0b08-5e42-4c67-95dc-7ee5de347ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af19fa6b-cd43-4cb7-a799-dd3272a9be9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume a6c0c67f-7644-4c31-8b58-ef28fae289e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3', 'volume_size': 1} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-38371beb-0aaa-4dd4-aa21-79154956f646 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:02 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-38371beb-0aaa-4dd4-aa21-79154956f646 Nov 06 10:52:02 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Flow 'volume_create_manager' (8b50e490-1599-4b3c-ad6a-920463405432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13400e41-0fdd-4ebc-b455-b8aa790e53b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13400e41-0fdd-4ebc-b455-b8aa790e53b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1594608859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40cb1935-8d68-48f3-8819-45411701a15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a19eaa126a4c1a97e081d2470c8ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:02Z,use_quota=True,user_id='42d94a43f26243f5bf518c47ce617292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c30622-96a3-48ae-a688-3cd2e09f535a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c30622-96a3-48ae-a688-3cd2e09f535a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d472e4a-8119-4b21-8ce5-baef2ebf03ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d472e4a-8119-4b21-8ce5-baef2ebf03ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40cb1935-8d68-48f3-8819-45411701a15d', 'volume_name': 'volume-40cb1935-8d68-48f3-8819-45411701a15d', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f935a50f-8ba7-48e9-ad1e-bce44ece2bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f935a50f-8ba7-48e9-ad1e-bce44ece2bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0e0ee3-e524-4eaf-b394-3fa8d9b2a698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Volume 40cb1935-8d68-48f3-8819-45411701a15d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40cb1935-8d68-48f3-8819-45411701a15d', 'volume_size': 1} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-38371beb-0aaa-4dd4-aa21-79154956f646" returned: 0 in 0.352s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1912406407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d1059d-474d-4610-895b-1c15d2293253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d2edca1ee7497b8f4e73174c724884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:01Z,use_quota=True,user_id='0e315dfc8ae44170b23368237e4c982b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Creating volume 44d1059d-474d-4610-895b-1c15d2293253 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:02 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d1059d-474d-4610-895b-1c15d2293253 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:02 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d1059d-474d-4610-895b-1c15d2293253 1073741824 Nov 06 10:52:02 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc81e3b-c40e-40d4-a15b-6944d0748c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38371beb-0aaa-4dd4-aa21-79154956f646', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c1d16b-89d8-4ecb-b7e1-ac40ffce2d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Flow 'volume_create_manager' (8fc1f4f2-ce88-41c4-82a8-580d5ec4b1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05570420-d25e-4d7a-ba67-1154e3e0bcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume volume-38371beb-0aaa-4dd4-aa21-79154956f646 (38371beb-0aaa-4dd4-aa21-79154956f646): created successfully Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c1d16b-89d8-4ecb-b7e1-ac40ffce2d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Flow 'volume_create_manager' (607a3505-9569-4f93-b2f6-9bd7654e12a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Flow 'volume_create_manager' (0ba9a5e4-b149-4243-8cfb-a472fc7c9a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f64499-9ead-49fb-b45d-34dc91fbcba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05570420-d25e-4d7a-ba67-1154e3e0bcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-817968184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c47ced-6157-4ef4-8a22-ccf5dabb012a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d2edca1ee7497b8f4e73174c724884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:02Z,use_quota=True,user_id='0e315dfc8ae44170b23368237e4c982b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5926de28-75dd-4767-96ed-2d44e010c09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5926de28-75dd-4767-96ed-2d44e010c09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7225c1d-e0d0-46a4-88ce-362ba6186552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7225c1d-e0d0-46a4-88ce-362ba6186552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10c47ced-6157-4ef4-8a22-ccf5dabb012a', 'volume_name': 'volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a9ebe1-141b-47e2-87ad-e055c59f36cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a9ebe1-141b-47e2-87ad-e055c59f36cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b28432-d240-4d47-963f-1555e79b1bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume 10c47ced-6157-4ef4-8a22-ccf5dabb012a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a', 'volume_size': 1} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:02 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-323d9dbd-9dfe-4d67-aa86-79bb75b33c58 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Created volume successfully. Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f64499-9ead-49fb-b45d-34dc91fbcba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1834264709',display_name='tempest-VolumesGetTest-Volume-1134370167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d2c6bb-126d-41d9-a6d1-23a80de9ff61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29efbffb1c434d84a3712be762000a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:03Z,use_quota=True,user_id='50c72d45cb084afd9b2a3171dee31a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef023a1-dcf1-4a8f-99ce-eaad0bf4b39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef023a1-dcf1-4a8f-99ce-eaad0bf4b39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aaf6917-efa2-4b80-9040-7b0b7ffbbba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aaf6917-efa2-4b80-9040-7b0b7ffbbba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09d2c6bb-126d-41d9-a6d1-23a80de9ff61', 'volume_name': 'volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b02acde-0a5d-4414-b007-f327aafab29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b02acde-0a5d-4414-b007-f327aafab29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040f06b0-4456-43de-a32b-ae424e33e410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Volume 09d2c6bb-126d-41d9-a6d1-23a80de9ff61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61', 'volume_size': 1} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=208,cinder:SELECT=160,cinder:DELETE=15,cinder:INSERT=60 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Flow 'volume_create_manager' (84ecf3ba-1ff0-42b3-aeab-896241f4844d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b51a07-fccd-4f33-9afd-cae0e62d3179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b51a07-fccd-4f33-9afd-cae0e62d3179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1586614060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903aef12-67e8-4c7c-afb9-2bc9f478efc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5c251a195742ec8089446d4e79ad11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:03Z,use_quota=True,user_id='1da1ed125db340bb89f5d94b3ac52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4eac490-639a-4a73-95ab-8e43631450e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4eac490-639a-4a73-95ab-8e43631450e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815f10c7-b609-477d-bcf5-56c60cf56f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815f10c7-b609-477d-bcf5-56c60cf56f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '903aef12-67e8-4c7c-afb9-2bc9f478efc0', 'volume_name': 'volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e2d905-d2b1-41f6-8a5d-40162f7cc07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e2d905-d2b1-41f6-8a5d-40162f7cc07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8585a860-c765-4b56-a42e-0e34ab049a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:02 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Volume 903aef12-67e8-4c7c-afb9-2bc9f478efc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0', 'volume_size': 1} Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:02 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d1059d-474d-4610-895b-1c15d2293253 1073741824" returned: 0 in 0.460s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d1059d-474d-4610-895b-1c15d2293253 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:03 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d1059d-474d-4610-895b-1c15d2293253 Nov 06 10:52:03 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:03 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d1059d-474d-4610-895b-1c15d2293253" returned: 0 in 0.250s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.145s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1116068315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c0c67f-7644-4c31-8b58-ef28fae289e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d2edca1ee7497b8f4e73174c724884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:02Z,use_quota=True,user_id='0e315dfc8ae44170b23368237e4c982b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Creating volume a6c0c67f-7644-4c31-8b58-ef28fae289e3 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:03 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e12a1b1-0fe4-4c3a-8f1a-dc2719cae33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d1059d-474d-4610-895b-1c15d2293253', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:03 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3 1073741824 Nov 06 10:52:03 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e61560-24b6-4f72-a675-1a02e7a69cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:03 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume volume-44d1059d-474d-4610-895b-1c15d2293253 (44d1059d-474d-4610-895b-1c15d2293253): created successfully Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e61560-24b6-4f72-a675-1a02e7a69cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Flow 'volume_create_manager' (37742fdb-5bd7-4ef3-a5a9-f2f2d74344f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:03 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-316d5e92-e530-424e-a6a5-e6f2d8a3ea36 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Created volume successfully. Nov 06 10:52:03 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3 1073741824" returned: 0 in 0.409s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:03 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3 Nov 06 10:52:03 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:03 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3" returned: 0 in 0.248s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.473s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1594608859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40cb1935-8d68-48f3-8819-45411701a15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a19eaa126a4c1a97e081d2470c8ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:02Z,use_quota=True,user_id='42d94a43f26243f5bf518c47ce617292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Creating volume 40cb1935-8d68-48f3-8819-45411701a15d {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:03 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-40cb1935-8d68-48f3-8819-45411701a15d 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:04 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-40cb1935-8d68-48f3-8819-45411701a15d 1073741824 Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af19fa6b-cd43-4cb7-a799-dd3272a9be9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:04 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6732531c-cce5-4897-afbc-a066741a0581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:04 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3 (a6c0c67f-7644-4c31-8b58-ef28fae289e3): created successfully Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6732531c-cce5-4897-afbc-a066741a0581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Flow 'volume_create_manager' (90430713-9ab1-4525-adce-767805cea1a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:04 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a74accd0-601c-48bc-b61b-45819ad36a13 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Created volume successfully. Nov 06 10:52:04 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-40cb1935-8d68-48f3-8819-45411701a15d 1073741824" returned: 0 in 0.444s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-40cb1935-8d68-48f3-8819-45411701a15d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:04 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-40cb1935-8d68-48f3-8819-45411701a15d Nov 06 10:52:04 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:04 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-40cb1935-8d68-48f3-8819-45411701a15d" returned: 0 in 0.245s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.965s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-817968184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c47ced-6157-4ef4-8a22-ccf5dabb012a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d2edca1ee7497b8f4e73174c724884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:02Z,use_quota=True,user_id='0e315dfc8ae44170b23368237e4c982b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Creating volume 10c47ced-6157-4ef4-8a22-ccf5dabb012a {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:04 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:04 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a 1073741824 Nov 06 10:52:04 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0e0ee3-e524-4eaf-b394-3fa8d9b2a698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40cb1935-8d68-48f3-8819-45411701a15d', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd1b5cd-2a5d-45cb-9b4b-2f5720b341a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:04 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Volume volume-40cb1935-8d68-48f3-8819-45411701a15d (40cb1935-8d68-48f3-8819-45411701a15d): created successfully Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd1b5cd-2a5d-45cb-9b4b-2f5720b341a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Flow 'volume_create_manager' (8b50e490-1599-4b3c-ad6a-920463405432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:04 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7ac0dd51-0a4d-4976-9632-73c19f50f416 tempest-VolumesTransfersV357Test-644595350 None] Created volume successfully. Nov 06 10:52:05 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a 1073741824" returned: 0 in 0.461s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:05 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a Nov 06 10:52:05 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:05 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a" returned: 0 in 0.257s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.671s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1834264709',display_name='tempest-VolumesGetTest-Volume-1134370167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d2c6bb-126d-41d9-a6d1-23a80de9ff61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29efbffb1c434d84a3712be762000a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:03Z,use_quota=True,user_id='50c72d45cb084afd9b2a3171dee31a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Creating volume 09d2c6bb-126d-41d9-a6d1-23a80de9ff61 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:05 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b28432-d240-4d47-963f-1555e79b1bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:05 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61 1073741824 Nov 06 10:52:05 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf62934-2b25-4bcd-8bd3-08f893ebbf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:05 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Volume volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a (10c47ced-6157-4ef4-8a22-ccf5dabb012a): created successfully Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf62934-2b25-4bcd-8bd3-08f893ebbf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Flow 'volume_create_manager' (8fc1f4f2-ce88-41c4-82a8-580d5ec4b1d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:05 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a0776057-f144-4bec-aa80-d0af2d1e70fa tempest-CreateVolumesFromSnapshotTest-1324845735 None] Created volume successfully. Nov 06 10:52:05 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-81c3ba81-fcf4-40e1-a267-b1f812a52ab3 tempest-VolumesTransfersV357Test-1508376542 None] Transfer volume completed successfully. Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "cinder-10c47ced-6157-4ef4-8a22-ccf5dabb012a-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-10c47ced-6157-4ef4-8a22-ccf5dabb012a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "cinder-quobyte-10c47ced-6157-4ef4-8a22-ccf5dabb012a" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-10c47ced-6157-4ef4-8a22-ccf5dabb012a" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cfac7e-2747-40ec-a64e-d07679a742f3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:06 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a Nov 06 10:52:06 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:06 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61 1073741824" returned: 0 in 0.586s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:06 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61 Nov 06 10:52:06 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Acquiring lock "cinder-40cb1935-8d68-48f3-8819-45411701a15d-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Lock "cinder-40cb1935-8d68-48f3-8819-45411701a15d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Acquiring lock "cinder-quobyte-40cb1935-8d68-48f3-8819-45411701a15d" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:06 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a" returned: 0 in 0.436s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Lock "cinder-quobyte-40cb1935-8d68-48f3-8819-45411701a15d" acquired by "delete_volume" :: waited 0.032s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:06 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a Nov 06 10:52:06 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4403998f-937f-438a-b07a-b50eb65a8735]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-40cb1935-8d68-48f3-8819-45411701a15d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:06 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61" returned: 0 in 0.318s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.518s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1586614060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903aef12-67e8-4c7c-afb9-2bc9f478efc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5c251a195742ec8089446d4e79ad11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:03Z,use_quota=True,user_id='1da1ed125db340bb89f5d94b3ac52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Creating volume 903aef12-67e8-4c7c-afb9-2bc9f478efc0 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:06 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:06 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-40cb1935-8d68-48f3-8819-45411701a15d Nov 06 10:52:06 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040f06b0-4456-43de-a32b-ae424e33e410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15cc96c-00f9-4a19-a754-d159b0d96969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:06 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0 1073741824 Nov 06 10:52:06 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:06 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Volume volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61 (09d2c6bb-126d-41d9-a6d1-23a80de9ff61): created successfully Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15cc96c-00f9-4a19-a754-d159b0d96969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Flow 'volume_create_manager' (0ba9a5e4-b149-4243-8cfb-a472fc7c9a8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:06 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-693a27f8-e82c-4f2a-8a0a-4ca6b22e5d3a tempest-VolumesGetTest-2022055069 None] Created volume successfully. Nov 06 10:52:06 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-10c47ced-6157-4ef4-8a22-ccf5dabb012a" returned: 0 in 0.278s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-10c47ced-6157-4ef4-8a22-ccf5dabb012a" released by "delete_volume" :: held 0.767s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Created reservations ['91ed623f-7960-4d4a-acb4-9f15d4cd548c', '8009d256-d2d5-4b8f-9ff9-dc1eae77ac80', '746f456e-0f5d-4478-af2f-36ee82ca2e4d', '807e5ac4-41b5-44b9-a3c8-7fd22866177e'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:06 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:06 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:06 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-40cb1935-8d68-48f3-8819-45411701a15d" returned: 0 in 0.441s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-40cb1935-8d68-48f3-8819-45411701a15d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:06 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-40cb1935-8d68-48f3-8819-45411701a15d Nov 06 10:52:06 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "cinder-a6c0c67f-7644-4c31-8b58-ef28fae289e3-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-a6c0c67f-7644-4c31-8b58-ef28fae289e3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "cinder-quobyte-a6c0c67f-7644-4c31-8b58-ef28fae289e3" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:07 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0 1073741824" returned: 0 in 0.575s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:07 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.332s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-a6c0c67f-7644-4c31-8b58-ef28fae289e3" acquired by "delete_volume" :: waited 0.033s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:07 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Deleted volume successfully. Nov 06 10:52:07 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-40cb1935-8d68-48f3-8819-45411701a15d" returned: 0 in 0.284s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6b631f-7446-4b61-a52d-775b7d09ff2f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Lock "cinder-quobyte-40cb1935-8d68-48f3-8819-45411701a15d" released by "delete_volume" :: held 0.802s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-12a077b5-ad8f-407d-9a32-c6e346ce3cfd tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-10c47ced-6157-4ef4-8a22-ccf5dabb012a-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:07 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0 Nov 06 10:52:07 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Created reservations ['abd8b5f2-43bd-4037-b4bb-625899435eb2', 'e6af2835-21c8-49ec-92e9-e0d1507b50a3', 'e7bfced8-e875-4b2a-85e9-5105f20413ff', '6533fe81-e82d-4bc3-8971-0403306fe36a'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:07 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3 Nov 06 10:52:07 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:07 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:07 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:07 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0" returned: 0 in 0.301s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8585a860-c765-4b56-a42e-0e34ab049a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9945bd-3b37-4156-933f-e1b4f2acb335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:07 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Volume volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0 (903aef12-67e8-4c7c-afb9-2bc9f478efc0): created successfully Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9945bd-3b37-4156-933f-e1b4f2acb335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Flow 'volume_create_manager' (84ecf3ba-1ff0-42b3-aeab-896241f4844d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:07 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a0818e86-dec8-4b43-9c07-8e5a0a1ce058 tempest-ProjectReaderTests-1588306292 None] Created volume successfully. Nov 06 10:52:07 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3" returned: 0 in 0.447s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:07 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.284s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:07 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Deleted volume successfully. Nov 06 10:52:07 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3 Nov 06 10:52:07 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a1f82001-fdab-47f7-8eb6-f23d85a94ba1 tempest-VolumesTransfersV357Test-965710100 None] Lock "cinder-40cb1935-8d68-48f3-8819-45411701a15d-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-09d2c6bb-126d-41d9-a6d1-23a80de9ff61-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:07 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a6c0c67f-7644-4c31-8b58-ef28fae289e3" returned: 0 in 0.316s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Lock "cinder-09d2c6bb-126d-41d9-a6d1-23a80de9ff61-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-a6c0c67f-7644-4c31-8b58-ef28fae289e3" released by "delete_volume" :: held 0.836s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-quobyte-09d2c6bb-126d-41d9-a6d1-23a80de9ff61" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-09d2c6bb-126d-41d9-a6d1-23a80de9ff61" acquired by "delete_volume" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Created reservations ['87fee125-54bc-447c-951f-1a1c4ef18903', 'bbbb337e-8f7e-4b02-a5db-6aaf583c7efa', '2a41cbb8-0d98-43c3-9967-229c5ef5129c', '0dc2603b-9257-48b2-9178-328c66330dfc'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c0c0a4-4935-4f09-a451-30c20cdc84ac]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Flow 'volume_create_manager' (04d909b4-3c64-4b22-a24d-1735895116ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2c8412-ff71-451e-a1d5-7daaf2c32e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2c8412-ff71-451e-a1d5-7daaf2c32e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-195092790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edd83fd-0be2-4db9-9cc7-8260f4a388ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a19eaa126a4c1a97e081d2470c8ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:08Z,use_quota=True,user_id='42d94a43f26243f5bf518c47ce617292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9becb1ef-1dac-4e63-9bb4-d8d723bc666f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9becb1ef-1dac-4e63-9bb4-d8d723bc666f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:08 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61 Nov 06 10:52:08 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e877670a-75ee-4fac-9edf-5485f2976457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e877670a-75ee-4fac-9edf-5485f2976457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9edd83fd-0be2-4db9-9cc7-8260f4a388ee', 'volume_name': 'volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ceddd1f-555b-4c3e-b51d-b8f4a0a7d587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ceddd1f-555b-4c3e-b51d-b8f4a0a7d587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ec4a23-16c7-43ab-a267-9d0153cee543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:08 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Volume 9edd83fd-0be2-4db9-9cc7-8260f4a388ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee', 'volume_size': 1} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-195092790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edd83fd-0be2-4db9-9cc7-8260f4a388ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a19eaa126a4c1a97e081d2470c8ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:08Z,use_quota=True,user_id='42d94a43f26243f5bf518c47ce617292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Creating volume 9edd83fd-0be2-4db9-9cc7-8260f4a388ee {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:08 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "cinder-44d1059d-474d-4610-895b-1c15d2293253-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:08 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee 1073741824 Nov 06 10:52:08 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-44d1059d-474d-4610-895b-1c15d2293253-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:08 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:08 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "cinder-quobyte-44d1059d-474d-4610-895b-1c15d2293253" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-44d1059d-474d-4610-895b-1c15d2293253" acquired by "delete_volume" :: waited 0.025s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05da6bf-547d-4d3b-bc4d-d6a711832133]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d1059d-474d-4610-895b-1c15d2293253 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:08 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Acquiring lock "cinder-903aef12-67e8-4c7c-afb9-2bc9f478efc0-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61" returned: 0 in 0.511s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:08 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d1059d-474d-4610-895b-1c15d2293253 Nov 06 10:52:08 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Lock "cinder-903aef12-67e8-4c7c-afb9-2bc9f478efc0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:08 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61 Nov 06 10:52:08 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Acquiring lock "cinder-quobyte-903aef12-67e8-4c7c-afb9-2bc9f478efc0" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Lock "cinder-quobyte-903aef12-67e8-4c7c-afb9-2bc9f478efc0" acquired by "delete_volume" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:08 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.398s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3d6ed0-77f5-4248-bfc2-d65e6bd7e461]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:08 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Deleted volume successfully. Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7dec93c2-b4ea-46ee-9f42-b15a59846ee0 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-a6c0c67f-7644-4c31-8b58-ef28fae289e3-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:08 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0 Nov 06 10:52:08 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:08 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:08 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee 1073741824" returned: 0 in 0.714s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09d2c6bb-126d-41d9-a6d1-23a80de9ff61" returned: 0 in 0.367s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:08 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d1059d-474d-4610-895b-1c15d2293253" returned: 0 in 0.501s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d1059d-474d-4610-895b-1c15d2293253 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-09d2c6bb-126d-41d9-a6d1-23a80de9ff61" released by "delete_volume" :: held 0.961s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:08 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d1059d-474d-4610-895b-1c15d2293253 Nov 06 10:52:08 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:08 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee Nov 06 10:52:09 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Created reservations ['0a312c7c-cb46-43f4-b40c-16e3b1796f17', '775c8d79-7ba9-4387-b658-706586d88290', '5bc96e2b-0610-48e1-a4fb-d9948de0e84f', '1deef6e0-9db4-49e8-9643-870531941f15'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:09 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:09 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:09 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0" returned: 0 in 0.524s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:09 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d1059d-474d-4610-895b-1c15d2293253" returned: 0 in 0.317s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:09 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0 Nov 06 10:52:09 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-44d1059d-474d-4610-895b-1c15d2293253" released by "delete_volume" :: held 0.899s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Created reservations ['d64337fc-39ea-4ca8-b81b-154270d9d685', 'b3b90bd0-9af8-4859-87d2-6f7e116cfef0', 'e233f25b-75c1-4af4-8c64-408fcd522d2d', '75a55d64-8b30-4791-bf1a-911ca6542681'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:09 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee" returned: 0 in 0.378s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ec4a23-16c7-43ab-a267-9d0153cee543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a229f392-c9f9-4bd2-ac52-61acacdca16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:09 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Volume volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee (9edd83fd-0be2-4db9-9cc7-8260f4a388ee): created successfully Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a229f392-c9f9-4bd2-ac52-61acacdca16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Flow 'volume_create_manager' (04d909b4-3c64-4b22-a24d-1735895116ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:09 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-98fb4f18-7204-4084-9053-96bfa649ee98 tempest-VolumesTransfersV357Test-644595350 None] Created volume successfully. Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:09 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:09 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:09 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.354s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:09 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Deleted volume successfully. Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-ba4a4f3f-622d-4204-a376-a346e7ec4e37 tempest-VolumesGetTest-2022055069 None] Lock "cinder-09d2c6bb-126d-41d9-a6d1-23a80de9ff61-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:09 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903aef12-67e8-4c7c-afb9-2bc9f478efc0" returned: 0 in 0.307s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Lock "cinder-quobyte-903aef12-67e8-4c7c-afb9-2bc9f478efc0" released by "delete_volume" :: held 0.882s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Created reservations ['059876fe-b12f-4a7c-9455-10bd295393e5', '927c7cd7-e4c8-4e47-94df-ac2e85aa933b', 'ab15f43a-c60e-49d9-8a84-15cd231d49c3', '6ec4f968-b203-4551-9bf1-c06f2ad83031'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:09 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:09 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:09 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.270s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:09 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Deleted volume successfully. Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-44c3f89a-fea0-4f99-9bb0-2bc9661f13db tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-44d1059d-474d-4610-895b-1c15d2293253-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:09 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.250s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:09 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Deleted volume successfully. Nov 06 10:52:09 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7e5ab683-8958-41cd-ab6c-fd49e25b4445 tempest-ProjectReaderTests-1588306292 None] Lock "cinder-903aef12-67e8-4c7c-afb9-2bc9f478efc0-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Flow 'volume_create_manager' (48561724-ac67-4ef0-b90f-0510951a43ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7316c99b-4975-477d-84bd-075929e51c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7316c99b-4975-477d-84bd-075929e51c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-701994381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b9af09-058d-49bf-bf7d-754f0a703baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5c251a195742ec8089446d4e79ad11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:10Z,use_quota=True,user_id='1da1ed125db340bb89f5d94b3ac52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a036b3ff-2369-4b95-b90d-441ebbd0bd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a036b3ff-2369-4b95-b90d-441ebbd0bd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e2b8e35-43bf-4274-bd72-1f7667b37bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e2b8e35-43bf-4274-bd72-1f7667b37bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7b9af09-058d-49bf-bf7d-754f0a703baf', 'volume_name': 'volume-d7b9af09-058d-49bf-bf7d-754f0a703baf', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce6e388-6986-411f-a7b3-e5c971dc4f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce6e388-6986-411f-a7b3-e5c971dc4f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531652dc-e825-4014-ae28-7e1e4a794358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:10 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Volume d7b9af09-058d-49bf-bf7d-754f0a703baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7b9af09-058d-49bf-bf7d-754f0a703baf', 'volume_size': 1} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-701994381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b9af09-058d-49bf-bf7d-754f0a703baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5c251a195742ec8089446d4e79ad11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:10Z,use_quota=True,user_id='1da1ed125db340bb89f5d94b3ac52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Creating volume d7b9af09-058d-49bf-bf7d-754f0a703baf {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:10 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d7b9af09-058d-49bf-bf7d-754f0a703baf 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-92fea3de-0609-41b0-8316-9199d49d472f-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:10 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d7b9af09-058d-49bf-bf7d-754f0a703baf 1073741824 Nov 06 10:52:10 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Lock "cinder-92fea3de-0609-41b0-8316-9199d49d472f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-quobyte-92fea3de-0609-41b0-8316-9199d49d472f" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-92fea3de-0609-41b0-8316-9199d49d472f" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5696e1b0-8aca-40ba-8d57-a0c43b629ebd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-92fea3de-0609-41b0-8316-9199d49d472f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "cinder-38371beb-0aaa-4dd4-aa21-79154956f646-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Acquiring lock "cinder-9edd83fd-0be2-4db9-9cc7-8260f4a388ee-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-38371beb-0aaa-4dd4-aa21-79154956f646-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:10 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-92fea3de-0609-41b0-8316-9199d49d472f Nov 06 10:52:10 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Lock "cinder-9edd83fd-0be2-4db9-9cc7-8260f4a388ee-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "cinder-quobyte-38371beb-0aaa-4dd4-aa21-79154956f646" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Acquiring lock "cinder-quobyte-9edd83fd-0be2-4db9-9cc7-8260f4a388ee" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-38371beb-0aaa-4dd4-aa21-79154956f646" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Lock "cinder-quobyte-9edd83fd-0be2-4db9-9cc7-8260f4a388ee" acquired by "delete_volume" :: waited 0.038s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae309acf-e26b-4bde-806b-ea76df54c578]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-38371beb-0aaa-4dd4-aa21-79154956f646 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aaa5d3-62db-4159-b74d-8f5667345253]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:10 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-38371beb-0aaa-4dd4-aa21-79154956f646 Nov 06 10:52:10 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:10 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee Nov 06 10:52:10 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:10 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-92fea3de-0609-41b0-8316-9199d49d472f" returned: 0 in 0.433s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-92fea3de-0609-41b0-8316-9199d49d472f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:10 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-92fea3de-0609-41b0-8316-9199d49d472f Nov 06 10:52:10 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:10 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d7b9af09-058d-49bf-bf7d-754f0a703baf 1073741824" returned: 0 in 0.635s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d7b9af09-058d-49bf-bf7d-754f0a703baf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:10 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d7b9af09-058d-49bf-bf7d-754f0a703baf Nov 06 10:52:10 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:11 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:11 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-38371beb-0aaa-4dd4-aa21-79154956f646" returned: 0 in 0.446s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-92fea3de-0609-41b0-8316-9199d49d472f" returned: 0 in 0.278s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-38371beb-0aaa-4dd4-aa21-79154956f646 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:11 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee" returned: 0 in 0.451s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:11 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-38371beb-0aaa-4dd4-aa21-79154956f646 Nov 06 10:52:11 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-92fea3de-0609-41b0-8316-9199d49d472f" released by "delete_volume" :: held 0.786s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:11 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee Nov 06 10:52:11 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:11 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d7b9af09-058d-49bf-bf7d-754f0a703baf" returned: 0 in 0.294s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Created reservations ['bc2c62a1-fc80-40c6-b79d-c1acf4f5bf48', '5c7036a1-4cfd-4a66-87a7-46fb03fd5b5c', 'b8254ad1-d5bc-47d8-a404-9c3a4728cec8', '676089be-3a7e-427a-8e3a-c7d77f13c7af'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531652dc-e825-4014-ae28-7e1e4a794358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b9af09-058d-49bf-bf7d-754f0a703baf', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2806ee-61f4-432a-a52b-45872748c707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:11 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Volume volume-d7b9af09-058d-49bf-bf7d-754f0a703baf (d7b9af09-058d-49bf-bf7d-754f0a703baf): created successfully Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2806ee-61f4-432a-a52b-45872748c707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Flow 'volume_create_manager' (48561724-ac67-4ef0-b90f-0510951a43ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:11 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-67859560-6234-43a6-ad36-2c01bc998272 tempest-ProjectReaderTests-1588306292 None] Created volume successfully. Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:11 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:11 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:11 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-38371beb-0aaa-4dd4-aa21-79154956f646" returned: 0 in 0.318s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:11 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-38371beb-0aaa-4dd4-aa21-79154956f646" released by "delete_volume" :: held 0.830s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9edd83fd-0be2-4db9-9cc7-8260f4a388ee" returned: 0 in 0.318s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Lock "cinder-quobyte-9edd83fd-0be2-4db9-9cc7-8260f4a388ee" released by "delete_volume" :: held 0.821s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Created reservations ['30b08fcd-e102-4273-a082-a902a6b8ff24', '5babe391-9e12-487b-af57-693741831e2a', 'f49729ef-a7c6-454f-a6a7-f22cb5f61df3', '467976bb-95fb-4fcc-a512-0a59695dd6ae'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Created reservations ['76b24709-5238-49d1-a691-07ccbcfebe04', 'be3650fd-d7e0-4a3f-a188-db99561133b7', '25bfcce8-e05a-4363-85c8-08a5a54f4e14', 'bf9b965a-6a63-4691-8050-8dcad15978ce'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:11 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.300s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:11 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:11 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:11 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Deleted volume successfully. Nov 06 10:52:11 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:11 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91ec6d9d-46e3-4ce8-a9e0-8e65068c9244 tempest-VolumesGetTest-2022055069 None] Lock "cinder-92fea3de-0609-41b0-8316-9199d49d472f-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "cinder-21901c29-e95d-4120-857c-067901b1f018-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-21901c29-e95d-4120-857c-067901b1f018-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "cinder-quobyte-21901c29-e95d-4120-857c-067901b1f018" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-21901c29-e95d-4120-857c-067901b1f018" acquired by "delete_volume" :: waited 0.026s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9196ca43-036f-44ea-8a35-fb5b50482f44]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21901c29-e95d-4120-857c-067901b1f018 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:12 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Flow 'volume_create_manager' (100f3105-89a8-4d9d-8770-4943bc689b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cfb7f6-28fd-4ebd-8bb7-4693dcef97c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.449s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:12 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Deleted volume successfully. Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cfb7f6-28fd-4ebd-8bb7-4693dcef97c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1115000405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876787a5-3a7c-4355-b754-50049c0767d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29efbffb1c434d84a3712be762000a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:12Z,use_quota=True,user_id='50c72d45cb084afd9b2a3171dee31a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:12 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef9fae7-7ffb-4244-a501-7cb903dc0bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef9fae7-7ffb-4244-a501-7cb903dc0bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb194bc6-2f8f-4012-9636-1b9f93ae553e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb194bc6-2f8f-4012-9636-1b9f93ae553e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '876787a5-3a7c-4355-b754-50049c0767d1', 'volume_name': 'volume-876787a5-3a7c-4355-b754-50049c0767d1', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e3fcb9-38d7-41cf-866e-1a052c2d3abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e3fcb9-38d7-41cf-866e-1a052c2d3abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c1db13-16f9-45ce-9af8-6f4a7ea2cec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:12 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Volume 876787a5-3a7c-4355-b754-50049c0767d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-876787a5-3a7c-4355-b754-50049c0767d1', 'volume_size': 1} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:12 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21901c29-e95d-4120-857c-067901b1f018 Nov 06 10:52:12 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1115000405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876787a5-3a7c-4355-b754-50049c0767d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29efbffb1c434d84a3712be762000a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:12Z,use_quota=True,user_id='50c72d45cb084afd9b2a3171dee31a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Creating volume 876787a5-3a7c-4355-b754-50049c0767d1 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:12 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.523s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:12 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Deleted volume successfully. Nov 06 10:52:12 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 1073741824 Nov 06 10:52:12 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-df027ffb-7fdd-467d-9186-6b44be4bcc28 tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-38371beb-0aaa-4dd4-aa21-79154956f646-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-32c03d17-b803-493b-b312-216fb58b051c tempest-VolumesTransfersV357Test-965710100 None] Lock "cinder-9edd83fd-0be2-4db9-9cc7-8260f4a388ee-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Acquiring lock "cinder-d7b9af09-058d-49bf-bf7d-754f0a703baf-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Lock "cinder-d7b9af09-058d-49bf-bf7d-754f0a703baf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=293,cinder:SELECT=209,cinder:INSERT=70,cinder:DELETE=32 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Acquiring lock "cinder-quobyte-d7b9af09-058d-49bf-bf7d-754f0a703baf" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Lock "cinder-quobyte-d7b9af09-058d-49bf-bf7d-754f0a703baf" acquired by "delete_volume" :: waited 0.025s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dafbff-f9ac-41c7-bb76-e6d49032e6ab]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d7b9af09-058d-49bf-bf7d-754f0a703baf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:12 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21901c29-e95d-4120-857c-067901b1f018" returned: 0 in 0.505s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21901c29-e95d-4120-857c-067901b1f018 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:12 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21901c29-e95d-4120-857c-067901b1f018 Nov 06 10:52:12 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:12 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d7b9af09-058d-49bf-bf7d-754f0a703baf Nov 06 10:52:12 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:12 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 1073741824" returned: 0 in 0.571s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:12 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 Nov 06 10:52:12 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:12 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-21901c29-e95d-4120-857c-067901b1f018" returned: 0 in 0.352s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-21901c29-e95d-4120-857c-067901b1f018" released by "delete_volume" :: held 0.937s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:12 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d7b9af09-058d-49bf-bf7d-754f0a703baf" returned: 0 in 0.478s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d7b9af09-058d-49bf-bf7d-754f0a703baf {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Created reservations ['0d766e30-4823-4028-82d4-121235770850', '50f6ec17-3ab5-47d7-bcad-c6a1d7d6941f', '4c2dc47e-a76b-428a-a406-6e7c6a26e708', 'a6a39d64-e976-439f-9905-e8823aee8bf0'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:13 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d7b9af09-058d-49bf-bf7d-754f0a703baf Nov 06 10:52:13 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:13 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:13 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:13 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1" returned: 0 in 0.368s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c1db13-16f9-45ce-9af8-6f4a7ea2cec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-876787a5-3a7c-4355-b754-50049c0767d1', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c87f6d-6058-41b1-aab8-702fcbcacfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:13 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Volume volume-876787a5-3a7c-4355-b754-50049c0767d1 (876787a5-3a7c-4355-b754-50049c0767d1): created successfully Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c87f6d-6058-41b1-aab8-702fcbcacfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Flow 'volume_create_manager' (100f3105-89a8-4d9d-8770-4943bc689b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:13 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b1e06e51-dbe9-40ad-bc2a-9923a86773e5 tempest-VolumesGetTest-2022055069 None] Created volume successfully. Nov 06 10:52:13 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d7b9af09-058d-49bf-bf7d-754f0a703baf" returned: 0 in 0.344s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Lock "cinder-quobyte-d7b9af09-058d-49bf-bf7d-754f0a703baf" released by "delete_volume" :: held 0.866s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Created reservations ['7d2fe85b-4e31-422b-ba30-db6f07f378e7', '44dd5c0a-5795-4e6b-88bd-3a88f0bb831f', '137418a8-1494-447a-bfe5-1120957bc9c7', '916a3ede-8104-403c-bd0f-22019172ec7f'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:13 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.306s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:13 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Deleted volume successfully. Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91d7df90-e673-4067-b608-ba7e3c86f9fe tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-21901c29-e95d-4120-857c-067901b1f018-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:13 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:13 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:13 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.297s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:13 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Deleted volume successfully. Nov 06 10:52:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b254576f-5854-447a-95c0-762e67cf11b7 tempest-ProjectReaderTests-1588306292 None] Lock "cinder-d7b9af09-058d-49bf-bf7d-754f0a703baf-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "cinder-19bc8e0e-e9fd-4922-ade5-94d4ccef0817-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-19bc8e0e-e9fd-4922-ade5-94d4ccef0817-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "cinder-quobyte-a57ab25a-e733-4ec3-b315-8062203ac9f1" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-a57ab25a-e733-4ec3-b315-8062203ac9f1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "cinder-quobyte-19bc8e0e-e9fd-4922-ade5-94d4ccef0817" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-19bc8e0e-e9fd-4922-ade5-94d4ccef0817" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Deleting offline snapshot 19bc8e0e-e9fd-4922-ade5-94d4ccef0817 of volume a57ab25a-e733-4ec3-b315-8062203ac9f1 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] snapshot_file for this snap is: volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3778ba-d021-4557-ba5c-28397785f83f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:14 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817 Nov 06 10:52:14 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Flow 'volume_create_manager' (c0b25c5f-2d28-4536-ba2a-eb0ab34569d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb255655-4af6-46ad-a70a-163e8a3e246d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb255655-4af6-46ad-a70a-163e8a3e246d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-185686646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='29efbffb1c434d84a3712be762000a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=876787a5-3a7c-4355-b754-50049c0767d1,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:15Z,use_quota=True,user_id='50c72d45cb084afd9b2a3171dee31a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3435fa3a-77ee-4621-b463-f62e7d031308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3435fa3a-77ee-4621-b463-f62e7d031308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df518af-3a06-4a67-ab93-f4ecdac6f016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df518af-3a06-4a67-ab93-f4ecdac6f016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9', 'volume_name': 'volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9', 'volume_size': 1, 'source_volid': '876787a5-3a7c-4355-b754-50049c0767d1', 'source_volstatus': 'available'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b85992-9adf-40a7-996c-b662e1557357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b85992-9adf-40a7-996c-b662e1557357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123f393f-eb41-4373-95b3-fb96c0141159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:14 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Volume 9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9', 'volume_size': 1, 'source_volid': '876787a5-3a7c-4355-b754-50049c0767d1', 'source_volstatus': 'available'} Nov 06 10:52:14 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817" returned: 0 in 0.535s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a57ab25a-e733-4ec3-b315-8062203ac9f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:14 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Cloning volume 876787a5-3a7c-4355-b754-50049c0767d1 to volume 9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9 Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2012548-6755-4bf2-9e26-ce2d75043240]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Creating offline snapshot 2146a87f-39a9-42fa-ab33-652935416cfd of volume 876787a5-3a7c-4355-b754-50049c0767d1 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceb8f09-a426-437f-96ac-a62f33581609]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:15 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 Nov 06 10:52:15 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:15 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 Nov 06 10:52:15 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:15 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1" returned: 0 in 0.563s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:15 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817 Nov 06 10:52:15 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:15 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1" returned: 0 in 0.607s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:15 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd 1G Nov 06 10:52:15 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:15 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817" returned: 0 in 0.531s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:16 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817 Nov 06 10:52:16 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:16 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd 1G" returned: 0 in 0.584s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876787a5-3a7c-4355-b754-50049c0767d1 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:16 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876787a5-3a7c-4355-b754-50049c0767d1 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd Nov 06 10:52:16 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:16 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1.19bc8e0e-e9fd-4922-ade5-94d4ccef0817" returned: 0 in 0.305s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-19bc8e0e-e9fd-4922-ade5-94d4ccef0817" released by "_delete_snapshot" :: held 2.086s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-a57ab25a-e733-4ec3-b315-8062203ac9f1" released by "delete_snapshot" :: held 2.122s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:16 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Created reservations ['9838b611-c032-404b-a178-3fb074d18561', 'dd9e2231-d261-41e7-aa75-bfe90b2d76ef', '24dd0375-52f1-49ea-bcc2-77d6cdab8217', '6fa79870-3495-40c7-a9f3-7a9e7801ca45'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:16 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Delete snapshot completed successfully. Nov 06 10:52:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-31489b61-c6dd-42bd-ba65-56c45479580c tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-19bc8e0e-e9fd-4922-ade5-94d4ccef0817-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:16 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876787a5-3a7c-4355-b754-50049c0767d1 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd" returned: 0 in 0.413s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:16 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd is being set with open permissions: ugo+rw Nov 06 10:52:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:16 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd Nov 06 10:52:16 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:16 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd" returned: 0 in 0.286s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:16 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.info Nov 06 10:52:16 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:17 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.info" returned: 0 in 0.264s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:17 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.info is being set with open permissions: ugo+rw Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:17 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.info Nov 06 10:52:17 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:17 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.info" returned: 0 in 0.279s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-quobyte-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9" by "_copy_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] snapshot: 2146a87f-39a9-42fa-ab33-652935416cfd, volume: 9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9, {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "cinder-a57ab25a-e733-4ec3-b315-8062203ac9f1-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c878fad-d711-44f3-b11e-678e7cd30914]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-a57ab25a-e733-4ec3-b315-8062203ac9f1-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "cinder-quobyte-a57ab25a-e733-4ec3-b315-8062203ac9f1" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-a57ab25a-e733-4ec3-b315-8062203ac9f1" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:17 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd Nov 06 10:52:17 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c725374c-6913-4aeb-a1a6-f2a5c8eb2edb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:17 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 Nov 06 10:52:17 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:18 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd" returned: 0 in 0.521s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-876787a5-3a7c-4355-b754-50049c0767d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[374a2b84-1fae-4e2d-9cfc-b49d6ed73c74]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:18 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1" returned: 0 in 0.495s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:18 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 Nov 06 10:52:18 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:18 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1 Nov 06 10:52:18 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:18 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a57ab25a-e733-4ec3-b315-8062203ac9f1" returned: 0 in 0.385s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:18 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1" returned: 0 in 0.559s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] will copy from snapshot at /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Creating direct copy from snapshot {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG cinder.utils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Path /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9 not found in is_blk_device check {{(pid=86819) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-quobyte-a57ab25a-e733-4ec3-b315-8062203ac9f1" released by "delete_volume" :: held 0.991s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:18 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9 Nov 06 10:52:18 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Created reservations ['13193f28-0059-434b-a594-a67de8f2c536', 'a167e9a5-b450-4ca3-a585-db6db6cbae36', '9c4eb915-2848-4ece-a424-5d7cb8023542', 'e241af4b-7379-4f75-a1c7-5c6080d050e2'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:18 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:18 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:19 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.331s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:19 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:19 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Deleted volume successfully. Nov 06 10:52:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-6c7d0650-0ae5-41ad-800f-3e6f4c5fa45e tempest-CreateVolumesFromSnapshotTest-1324845735 None] Lock "cinder-a57ab25a-e733-4ec3-b315-8062203ac9f1-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:27 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9" returned: 0 in 9.180s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:27 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Image conversion details: src /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1, size 1024.00 MB, duration 9.18 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9 {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:52:27 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Converted 1024.00 MB image at 111.52 MB/s Nov 06 10:52:27 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9 is being set with open permissions: ugo+rw Nov 06 10:52:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:27 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9 Nov 06 10:52:27 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:28 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9" returned: 0 in 0.391s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9" released by "_copy_volume_from_snapshot" :: held 10.774s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-quobyte-2146a87f-39a9-42fa-ab33-652935416cfd" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-2146a87f-39a9-42fa-ab33-652935416cfd" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Deleting offline snapshot 2146a87f-39a9-42fa-ab33-652935416cfd of volume 876787a5-3a7c-4355-b754-50049c0767d1 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:52:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] snapshot_file for this snap is: volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:52:28 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6546965-2056-4564-8536-f1b710f453dc]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:28 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd Nov 06 10:52:28 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:28 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=80,cinder:UPDATE=127,cinder:INSERT=30,cinder:DELETE=11 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:52:28 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd" returned: 0 in 0.515s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-876787a5-3a7c-4355-b754-50049c0767d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:52:28 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae37fdf8-bd92-4493-82be-b60efd77b28a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:29 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 Nov 06 10:52:29 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:29 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1" returned: 0 in 0.807s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:29 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd Nov 06 10:52:29 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:30 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd" returned: 0 in 0.542s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:30 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd Nov 06 10:52:30 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:30 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1.2146a87f-39a9-42fa-ab33-652935416cfd" returned: 0 in 0.286s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-2146a87f-39a9-42fa-ab33-652935416cfd" released by "_delete_snapshot" :: held 2.313s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.828s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123f393f-eb41-4373-95b3-fb96c0141159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9', 'volume_size': 1, 'source_volid': '876787a5-3a7c-4355-b754-50049c0767d1', 'source_volstatus': 'available'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee6d728-9aab-42ed-b9eb-a4d1d9ea6a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:30 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Volume volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9 (9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9): created successfully Nov 06 10:52:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee6d728-9aab-42ed-b9eb-a4d1d9ea6a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Flow 'volume_create_manager' (c0b25c5f-2d28-4536-ba2a-eb0ab34569d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-dd0083aa-9d5e-4de5-bbe7-75e97e697f83 tempest-VolumesGetTest-2022055069 None] Created volume successfully. Nov 06 10:52:31 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Flow 'volume_create_manager' (7e01ef59-19b7-4a48-b3ac-68a7db786946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c893a1-17a0-4017-80be-af17fe639a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c893a1-17a0-4017-80be-af17fe639a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b2454f-eaa8-4411-a37c-db5396f2b5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fabadb53c9463fbb914589caece4a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:31Z,use_quota=True,user_id='21d3565dabda4efda88884fb2bbbb1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292ca944-0624-45b7-a25c-e2db61faa67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292ca944-0624-45b7-a25c-e2db61faa67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55930a7b-e1f1-4f21-b2d5-be391d039b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:31 devstack cinder-volume[86819]: DEBUG cinder.image.glance [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Creating Keystone auth plugin from conf {{(pid=86819) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55930a7b-e1f1-4f21-b2d5-be391d039b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35b2454f-eaa8-4411-a37c-db5396f2b5cc', 'volume_name': 'volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc', 'volume_size': 1, 'image_id': 'eecdc47a-81f2-4326-9307-8390c43d2126', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eecdc47a-81f2-4326-9307-8390c43d2126', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8192a83f91e19c8bcf2296df9ea6dbe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e1fabadb53c9463fbb914589caece4a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '236ed61b702a36cea26e71defe3fd3f64106ad75e6b26db4f3b553ae4b2fbb1015658c8f38069741dd8bbd11d3ce8c41490491fdb2176c4074cdac1f8ca41bc0', 'id': 'eecdc47a-81f2-4326-9307-8390c43d2126', 'created_at': datetime.datetime(2026, 11, 6, 9, 52, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 52, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eecdc47a-81f2-4326-9307-8390c43d2126/file', 'properties': {}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc5c7d0-9250-4530-afc3-6db2ba360ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc5c7d0-9250-4530-afc3-6db2ba360ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa76d23-510e-4bf5-bfcb-5f31533d5194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:32 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Volume 35b2454f-eaa8-4411-a37c-db5396f2b5cc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc', 'volume_size': 1, 'image_id': 'eecdc47a-81f2-4326-9307-8390c43d2126', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eecdc47a-81f2-4326-9307-8390c43d2126', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8192a83f91e19c8bcf2296df9ea6dbe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e1fabadb53c9463fbb914589caece4a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '236ed61b702a36cea26e71defe3fd3f64106ad75e6b26db4f3b553ae4b2fbb1015658c8f38069741dd8bbd11d3ce8c41490491fdb2176c4074cdac1f8ca41bc0', 'id': 'eecdc47a-81f2-4326-9307-8390c43d2126', 'created_at': datetime.datetime(2026, 11, 6, 9, 52, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 52, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eecdc47a-81f2-4326-9307-8390c43d2126/file', 'properties': {}}, 'image_service': } Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Trying to clone 35b2454f-eaa8-4411-a37c-db5396f2b5cc from image eecdc47a-81f2-4326-9307-8390c43d2126 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eecdc47a-81f2-4326-9307-8390c43d2126', 'metadata': {}}]). {{(pid=86819) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 10:52:32 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Image download 0.00 MB at 0.00 MB/s Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79d81b2-bf4e-4d44-98fa-2bbce73a0ec0]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:32 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD Nov 06 10:52:32 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Flow 'volume_create_manager' (6a658a59-d748-4436-838d-8411d4a7132b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f91c1a-0991-4ac4-b212-d1356812d2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:32 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f91c1a-0991-4ac4-b212-d1356812d2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1538630602',display_name='tempest-VolumesGetTest-Volume-215973495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0080887e-ed77-4115-bfba-b98c4706ed76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29efbffb1c434d84a3712be762000a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:33Z,use_quota=True,user_id='50c72d45cb084afd9b2a3171dee31a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a408af-1e4b-4050-bd1a-b32a86fbff46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a408af-1e4b-4050-bd1a-b32a86fbff46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb053756-58dd-4a74-afe6-785e0bbb21e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb053756-58dd-4a74-afe6-785e0bbb21e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0080887e-ed77-4115-bfba-b98c4706ed76', 'volume_name': 'volume-0080887e-ed77-4115-bfba-b98c4706ed76', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d174c7-0066-4f06-a962-36b9b59e9222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d174c7-0066-4f06-a962-36b9b59e9222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e830f9-b957-4feb-9c64-71d8c13643cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:32 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Volume 0080887e-ed77-4115-bfba-b98c4706ed76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0080887e-ed77-4115-bfba-b98c4706ed76', 'volume_size': 1} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1538630602',display_name='tempest-VolumesGetTest-Volume-215973495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0080887e-ed77-4115-bfba-b98c4706ed76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29efbffb1c434d84a3712be762000a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:33Z,use_quota=True,user_id='50c72d45cb084afd9b2a3171dee31a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Creating volume 0080887e-ed77-4115-bfba-b98c4706ed76 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:32 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0080887e-ed77-4115-bfba-b98c4706ed76 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:32 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0080887e-ed77-4115-bfba-b98c4706ed76 1073741824 Nov 06 10:52:32 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:32 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD Nov 06 10:52:32 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:33 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD" returned: 1 in 0.517s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:52:33 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Temporary image eecdc47a-81f2-4326-9307-8390c43d2126 is fetched for user 21d3565dabda4efda88884fb2bbbb1a0. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 10:52:33 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c7bb6c-f240-486b-969e-1ae614fbff36]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:33 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0080887e-ed77-4115-bfba-b98c4706ed76 1073741824" returned: 0 in 0.633s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0080887e-ed77-4115-bfba-b98c4706ed76 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:33 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD Nov 06 10:52:33 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:33 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0080887e-ed77-4115-bfba-b98c4706ed76 Nov 06 10:52:33 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:33 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:33 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0080887e-ed77-4115-bfba-b98c4706ed76" returned: 0 in 0.390s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e830f9-b957-4feb-9c64-71d8c13643cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0080887e-ed77-4115-bfba-b98c4706ed76', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:33 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251d70f1-b6d0-49f8-b560-c0961c50ae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:34 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Volume volume-0080887e-ed77-4115-bfba-b98c4706ed76 (0080887e-ed77-4115-bfba-b98c4706ed76): created successfully Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251d70f1-b6d0-49f8-b560-c0961c50ae90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Flow 'volume_create_manager' (6a658a59-d748-4436-838d-8411d4a7132b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:34 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD Nov 06 10:52:34 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-0338ab13-d366-4a10-a111-47fb45c42afb tempest-VolumesGetTest-2022055069 None] Created volume successfully. Nov 06 10:52:34 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:34 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD" returned: 1 in 0.411s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b2454f-eaa8-4411-a37c-db5396f2b5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fabadb53c9463fbb914589caece4a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:31Z,use_quota=True,user_id='21d3565dabda4efda88884fb2bbbb1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Creating volume 35b2454f-eaa8-4411-a37c-db5396f2b5cc {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:34 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:34 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc 1073741824 Nov 06 10:52:34 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:34 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc 1073741824" returned: 0 in 0.587s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-0080887e-ed77-4115-bfba-b98c4706ed76-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Lock "cinder-0080887e-ed77-4115-bfba-b98c4706ed76-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-quobyte-0080887e-ed77-4115-bfba-b98c4706ed76" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:35 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc Nov 06 10:52:35 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-0080887e-ed77-4115-bfba-b98c4706ed76" acquired by "delete_volume" :: waited 0.028s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c7b2c2-0ee2-413d-a4da-1c4e41d7c2ab]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0080887e-ed77-4115-bfba-b98c4706ed76 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:35 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0080887e-ed77-4115-bfba-b98c4706ed76 Nov 06 10:52:35 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:35 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc" returned: 0 in 0.318s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Attempting download of eecdc47a-81f2-4326-9307-8390c43d2126 ((None, [{'url': 'file:///opt/stack/data/glance/images/eecdc47a-81f2-4326-9307-8390c43d2126', 'metadata': {}}])) to volume 35b2454f-eaa8-4411-a37c-db5396f2b5cc. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e576245c-d683-4d3d-bebb-f59204d5746b]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eecdc47a-81f2-4326-9307-8390c43d2126_dgnxrp1d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:35 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eecdc47a-81f2-4326-9307-8390c43d2126_dgnxrp1d Nov 06 10:52:35 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:35 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0080887e-ed77-4115-bfba-b98c4706ed76" returned: 0 in 0.513s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0080887e-ed77-4115-bfba-b98c4706ed76 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:35 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0080887e-ed77-4115-bfba-b98c4706ed76 Nov 06 10:52:35 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:35 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eecdc47a-81f2-4326-9307-8390c43d2126_dgnxrp1d" returned: 0 in 0.352s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eecdc47a-81f2-4326-9307-8390c43d2126_dgnxrp1d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:35 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0080887e-ed77-4115-bfba-b98c4706ed76" returned: 0 in 0.308s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:35 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eecdc47a-81f2-4326-9307-8390c43d2126_dgnxrp1d Nov 06 10:52:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-0080887e-ed77-4115-bfba-b98c4706ed76" released by "delete_volume" :: held 0.886s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:35 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Created reservations ['a9297c66-8d90-4d21-b17a-42fbd25dd921', 'a8ca7363-086a-4025-a443-bc2936d60bac', '0adc012e-bed9-4bb2-9009-8cee56376535', 'ee14567a-560a-4f7d-a1e2-af6f914f13dc'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:36 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:36 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:36 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:36 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:36 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eecdc47a-81f2-4326-9307-8390c43d2126_dgnxrp1d" returned: 1 in 0.448s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eecdc47a-81f2-4326-9307-8390c43d2126_dgnxrp1d' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fb81b1-fad8-40b1-9083-ca0ad2552a0c]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:36 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD Nov 06 10:52:36 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:36 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.440s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 29 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:52:36 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.461s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:36 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Deleted volume successfully. Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b62ff543-4b27-416a-b5a3-407bcbb0813f tempest-VolumesGetTest-2022055069 None] Lock "cinder-0080887e-ed77-4115-bfba-b98c4706ed76-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:36 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD" returned: 0 in 0.573s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:36 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD Nov 06 10:52:36 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:37 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:52:37 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] eecdc47a-81f2-4326-9307-8390c43d2126 was raw, converting to qcow2 {{(pid=86819) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 10:52:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:37 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc Nov 06 10:52:37 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Lock "cinder-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-quobyte-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9" acquired by "delete_volume" :: waited 0.025s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:37 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[65385846-7f06-4b25-957e-d7df0d53c9b9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:37 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9 Nov 06 10:52:37 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:37 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc" returned: 0 in 0.626s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:37 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eecdc47a-81f2-4326-9307-8390c43d2126_rshn5s6adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:52:37 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 10:52:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:37 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc 1G Nov 06 10:52:37 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:38 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9" returned: 0 in 0.526s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:38 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9 Nov 06 10:52:38 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:38 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc 1G" returned: 0 in 0.469s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Downloaded image eecdc47a-81f2-4326-9307-8390c43d2126 ((None, [{'url': 'file:///opt/stack/data/glance/images/eecdc47a-81f2-4326-9307-8390c43d2126', 'metadata': {}}])) to volume 35b2454f-eaa8-4411-a37c-db5396f2b5cc successfully. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Temporary image eecdc47a-81f2-4326-9307-8390c43d2126 for user 21d3565dabda4efda88884fb2bbbb1a0 is deleted. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Marking volume 35b2454f-eaa8-4411-a37c-db5396f2b5cc as bootable. {{(pid=86819) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Copying metadata from image eecdc47a-81f2-4326-9307-8390c43d2126 to 35b2454f-eaa8-4411-a37c-db5396f2b5cc. {{(pid=86819) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Creating volume glance metadata for volume 35b2454f-eaa8-4411-a37c-db5396f2b5cc backed by image eecdc47a-81f2-4326-9307-8390c43d2126 with: {'image_id': 'eecdc47a-81f2-4326-9307-8390c43d2126', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd8192a83f91e19c8bcf2296df9ea6dbe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86819) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 10:52:38 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9" returned: 0 in 0.336s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9" released by "delete_volume" :: held 0.925s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa76d23-510e-4bf5-bfcb-5f31533d5194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc', 'volume_size': 1, 'image_id': 'eecdc47a-81f2-4326-9307-8390c43d2126', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eecdc47a-81f2-4326-9307-8390c43d2126', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8192a83f91e19c8bcf2296df9ea6dbe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e1fabadb53c9463fbb914589caece4a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '236ed61b702a36cea26e71defe3fd3f64106ad75e6b26db4f3b553ae4b2fbb1015658c8f38069741dd8bbd11d3ce8c41490491fdb2176c4074cdac1f8ca41bc0', 'id': 'eecdc47a-81f2-4326-9307-8390c43d2126', 'created_at': datetime.datetime(2026, 11, 6, 9, 52, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 52, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eecdc47a-81f2-4326-9307-8390c43d2126/file', 'properties': {}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed012fe-a2bc-44d5-bb8d-5a67db2540e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:38 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Volume volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc (35b2454f-eaa8-4411-a37c-db5396f2b5cc): created successfully Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed012fe-a2bc-44d5-bb8d-5a67db2540e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Flow 'volume_create_manager' (7e01ef59-19b7-4a48-b3ac-68a7db786946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:38 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-6378a52d-1453-4192-9a21-a340a4fa1626 tempest-VolumeImageDependencyTests-394357169 None] Created volume successfully. Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Created reservations ['ed462aa3-7a1a-43f3-a574-7fae52cb84fc', '89f785ca-686b-47e2-b00f-5b3b03b8f9ce', 'a2688bf7-cc53-47ae-897d-ca82753b9afc', '18a85fbb-fee7-4ed3-9568-763438832e2d'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:38 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:38 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:38 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.253s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:38 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Deleted volume successfully. Nov 06 10:52:38 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8eadc43b-b3c8-42f5-9199-6507e2eec023 tempest-VolumesGetTest-2022055069 None] Lock "cinder-9d7cf2cb-6b43-45dc-9a9c-d41d8b5c71a9-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Acquiring lock "cinder-35b2454f-eaa8-4411-a37c-db5396f2b5cc-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Lock "cinder-35b2454f-eaa8-4411-a37c-db5396f2b5cc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Acquiring lock "cinder-quobyte-35b2454f-eaa8-4411-a37c-db5396f2b5cc" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Lock "cinder-quobyte-35b2454f-eaa8-4411-a37c-db5396f2b5cc" acquired by "delete_volume" :: waited 0.032s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:39 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83499cb-682e-45ac-abe9-ac90c104d203]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:39 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc Nov 06 10:52:39 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:39 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc" returned: 0 in 0.442s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:39 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc Nov 06 10:52:39 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-876787a5-3a7c-4355-b754-50049c0767d1-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Lock "cinder-876787a5-3a7c-4355-b754-50049c0767d1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-quobyte-876787a5-3a7c-4355-b754-50049c0767d1" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-876787a5-3a7c-4355-b754-50049c0767d1" acquired by "delete_volume" :: waited 0.038s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc185189-5966-41b3-acf3-e15ab14a6a0c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:40 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-35b2454f-eaa8-4411-a37c-db5396f2b5cc" returned: 0 in 0.496s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Lock "cinder-quobyte-35b2454f-eaa8-4411-a37c-db5396f2b5cc" released by "delete_volume" :: held 0.999s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Created reservations ['c765d1c8-78ef-42c4-b31e-dc00eeeccda7', '756477c6-ddf8-4c20-b21f-bcbfdd91d856', '6815d716-7317-4d05-a72f-42c0a6cc8d6a', 'a2d09ddf-5306-42b0-b3c9-23dbe2f7ee7a'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:40 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 Nov 06 10:52:40 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:40 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:40 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:40 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.317s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:40 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Deleted volume successfully. Nov 06 10:52:40 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1" returned: 0 in 0.664s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:40 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-624c8e32-8205-40b5-b24f-a9b62175585f tempest-VolumeImageDependencyTests-394357169 None] Lock "cinder-35b2454f-eaa8-4411-a37c-db5396f2b5cc-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:40 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1 Nov 06 10:52:40 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:41 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-876787a5-3a7c-4355-b754-50049c0767d1" returned: 0 in 0.294s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:41 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-876787a5-3a7c-4355-b754-50049c0767d1" released by "delete_volume" :: held 1.088s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:41 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Created reservations ['85a4324b-c4af-4678-9c94-da5118b40024', '4feae91a-7b91-4ff7-891c-ebad1a3cd4db', '1d4160c7-8ea4-41ca-8bec-d07c39479a3f', '01247146-ca47-4499-9257-98b586de896d'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:41 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:41 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:41 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:41 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.463s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:41 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:41 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Deleted volume successfully. Nov 06 10:52:41 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d0f04bff-5f8b-4a2b-971d-92432d9b8736 tempest-VolumesGetTest-2022055069 None] Lock "cinder-876787a5-3a7c-4355-b754-50049c0767d1-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:43 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Flow 'volume_create_manager' (8abb4eaa-eb9e-41c5-a8f1-1aa3a00f8994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bc1533-959a-4fc0-bc57-e053287cc6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bc1533-959a-4fc0-bc57-e053287cc6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-315767739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7060d910-4aac-46df-bffd-c9687e2aa728,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='29efbffb1c434d84a3712be762000a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:43Z,use_quota=True,user_id='50c72d45cb084afd9b2a3171dee31a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e0f928-6e57-4df4-bf3c-13f9c8c4c7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e0f928-6e57-4df4-bf3c-13f9c8c4c7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9128b6d6-1df8-4312-8b3c-ba4e93373c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:43 devstack cinder-volume[86819]: DEBUG cinder.image.glance [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Creating Keystone auth plugin from conf {{(pid=86819) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 10:52:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9128b6d6-1df8-4312-8b3c-ba4e93373c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7060d910-4aac-46df-bffd-c9687e2aa728', 'volume_name': 'volume-7060d910-4aac-46df-bffd-c9687e2aa728', 'volume_size': 1, 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a31bb778f245ada373212e6fd01b04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'created_at': datetime.datetime(2026, 11, 6, 9, 33, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3141da4f-e70d-439b-81af-e22387bd01d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be3f5c3-d9a0-42d2-af0a-c9938a5acaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be3f5c3-d9a0-42d2-af0a-c9938a5acaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9004d4-942a-4d2f-bf92-fb92801c5861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:43 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Volume 7060d910-4aac-46df-bffd-c9687e2aa728: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7060d910-4aac-46df-bffd-c9687e2aa728', 'volume_size': 1, 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a31bb778f245ada373212e6fd01b04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'created_at': datetime.datetime(2026, 11, 6, 9, 33, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3141da4f-e70d-439b-81af-e22387bd01d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 10:52:43 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Trying to clone 7060d910-4aac-46df-bffd-c9687e2aa728 from image 3141da4f-e70d-439b-81af-e22387bd01d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]). {{(pid=86819) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 10:52:44 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_ad9gs0pxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 10:52:44 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Image download 20.69 MB at 20.69 MB/s Nov 06 10:52:44 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c06d668-6f43-4712-904c-ca0690fbeda5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_ad9gs0pxdevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:44 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_ad9gs0pxdevstack@QuobyteHD Nov 06 10:52:44 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:44 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_ad9gs0pxdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:44 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Temporary image 3141da4f-e70d-439b-81af-e22387bd01d4 is fetched for user 50c72d45cb084afd9b2a3171dee31a0f. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 10:52:44 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9334502-fe9d-4aec-8cbd-87f8567c9ac6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_ad9gs0pxdevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:44 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_ad9gs0pxdevstack@QuobyteHD Nov 06 10:52:44 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:45 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_ad9gs0pxdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-315767739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7060d910-4aac-46df-bffd-c9687e2aa728,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='29efbffb1c434d84a3712be762000a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:43Z,use_quota=True,user_id='50c72d45cb084afd9b2a3171dee31a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Creating volume 7060d910-4aac-46df-bffd-c9687e2aa728 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:45 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:45 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728 1073741824 Nov 06 10:52:45 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:45 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728 1073741824" returned: 0 in 0.668s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:45 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728 Nov 06 10:52:45 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:46 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728" returned: 0 in 0.359s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:46 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Attempting download of 3141da4f-e70d-439b-81af-e22387bd01d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}])) to volume 7060d910-4aac-46df-bffd-c9687e2aa728. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 10:52:46 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85afbf6-3704-438f-80ac-c1652261588b]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_y58cxsws {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:46 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_y58cxsws Nov 06 10:52:46 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:46 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_y58cxsws" returned: 0 in 0.441s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_y58cxsws {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:47 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_y58cxsws Nov 06 10:52:47 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:47 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_y58cxsws" returned: 1 in 0.405s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_y58cxsws' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26485b8-73d2-4239-bc06-d07424ea67e2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_ad9gs0pxdevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:47 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_ad9gs0pxdevstack@QuobyteHD Nov 06 10:52:47 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Flow 'volume_create_manager' (81ac2812-b6fd-4777-90f0-c8ea8b13a984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88052a7-e991-4280-b0b3-3b5de5a36cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88052a7-e991-4280-b0b3-3b5de5a36cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1181315954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38cba83-5fcf-4ed4-8a7b-c743ac29eceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf78564650246f7abe11cccdc132922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:48Z,use_quota=True,user_id='42b106feb7a14d2793240f85a2d729e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b06e0a-ba1d-4ca1-95d3-05d874c6c875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b06e0a-ba1d-4ca1-95d3-05d874c6c875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc292eae-7ec4-4ab2-8a2d-5bb0a0112e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc292eae-7ec4-4ab2-8a2d-5bb0a0112e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a38cba83-5fcf-4ed4-8a7b-c743ac29eceb', 'volume_name': 'volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc4e568-ab25-4fcc-9c28-9a2916717db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc4e568-ab25-4fcc-9c28-9a2916717db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1084a6af-7323-4655-9c5b-f606ebefc972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:47 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Volume a38cba83-5fcf-4ed4-8a7b-c743ac29eceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb', 'volume_size': 1} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1181315954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38cba83-5fcf-4ed4-8a7b-c743ac29eceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf78564650246f7abe11cccdc132922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:48Z,use_quota=True,user_id='42b106feb7a14d2793240f85a2d729e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Creating volume a38cba83-5fcf-4ed4-8a7b-c743ac29eceb {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:47 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:47 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb 1073741824 Nov 06 10:52:47 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:47 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_ad9gs0pxdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] 3141da4f-e70d-439b-81af-e22387bd01d4 was qcow2, converting to qcow2 {{(pid=86819) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 10:52:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_ad9gs0pxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:47 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_ad9gs0pxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728 Nov 06 10:52:47 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:48 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb 1073741824" returned: 0 in 0.528s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:48 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb Nov 06 10:52:48 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:48 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb" returned: 0 in 0.376s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1084a6af-7323-4655-9c5b-f606ebefc972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b36107-0ae9-483f-a8e3-5f7b6a3f1fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:48 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Volume volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb (a38cba83-5fcf-4ed4-8a7b-c743ac29eceb): created successfully Nov 06 10:52:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b36107-0ae9-483f-a8e3-5f7b6a3f1fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:48 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Flow 'volume_create_manager' (81ac2812-b6fd-4777-90f0-c8ea8b13a984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:48 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2befb967-2513-40c0-90b9-846fb70ca59e tempest-SnapshotDependencyTests-521457354 None] Created volume successfully. Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Flow 'volume_create_manager' (e5cfc4e7-dfa6-41d1-a145-7c9869b4d154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b276aa-fa76-4ba7-a75f-11084e8f6421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b276aa-fa76-4ba7-a75f-11084e8f6421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b074c7e8fc42709d3b9c3fc9a392bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:49Z,use_quota=True,user_id='8623045873a448bb94fd5e3d06a1d90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a640dc6-acf7-47ab-b355-4d44e293c563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a640dc6-acf7-47ab-b355-4d44e293c563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9367dd-0ec1-4728-9b3c-22f17acf26a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9367dd-0ec1-4728-9b3c-22f17acf26a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87', 'volume_name': 'volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ffee60-3dac-4049-85ab-8535ee49a207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ffee60-3dac-4049-85ab-8535ee49a207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e100328-0468-43fd-b733-322dc67f100a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:49 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Volume 3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87', 'volume_size': 1} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b074c7e8fc42709d3b9c3fc9a392bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:49Z,use_quota=True,user_id='8623045873a448bb94fd5e3d06a1d90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Creating volume 3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:49 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:49 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87 1073741824 Nov 06 10:52:49 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:49 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87 1073741824" returned: 0 in 0.541s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:49 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87 Nov 06 10:52:49 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:50 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_ad9gs0pxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728" returned: 0 in 2.335s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_ad9gs0pxdevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728 {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:52:50 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Converted 112.00 MB image at 47.94 MB/s Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:50 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728 1G Nov 06 10:52:50 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:50 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87" returned: 0 in 0.371s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.178s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e100328-0468-43fd-b733-322dc67f100a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70372d2-4f82-4a02-9176-416626c61853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] Creating offline snapshot 524af09d-0a00-4b62-ab41-b184efb1cdfb of volume a38cba83-5fcf-4ed4-8a7b-c743ac29eceb {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:52:50 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Volume volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87 (3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87): created successfully Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70372d2-4f82-4a02-9176-416626c61853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Flow 'volume_create_manager' (e5cfc4e7-dfa6-41d1-a145-7c9869b4d154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db8e1a6-06b8-4a77-8f88-97f574f92e40]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:50 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-86827aab-7a41-457f-b031-4f6d3e5a3a76 tempest-CinderUnicodeTest-1723306910 None] Created volume successfully. Nov 06 10:52:50 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb Nov 06 10:52:50 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:50 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728 1G" returned: 0 in 0.354s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Downloaded image 3141da4f-e70d-439b-81af-e22387bd01d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}])) to volume 7060d910-4aac-46df-bffd-c9687e2aa728 successfully. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Temporary image 3141da4f-e70d-439b-81af-e22387bd01d4 for user 50c72d45cb084afd9b2a3171dee31a0f is deleted. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Marking volume 7060d910-4aac-46df-bffd-c9687e2aa728 as bootable. {{(pid=86819) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Copying metadata from image 3141da4f-e70d-439b-81af-e22387bd01d4 to 7060d910-4aac-46df-bffd-c9687e2aa728. {{(pid=86819) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Creating volume glance metadata for volume 7060d910-4aac-46df-bffd-c9687e2aa728 backed by image 3141da4f-e70d-439b-81af-e22387bd01d4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86819) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9004d4-942a-4d2f-bf92-fb92801c5861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7060d910-4aac-46df-bffd-c9687e2aa728', 'volume_size': 1, 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a31bb778f245ada373212e6fd01b04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'created_at': datetime.datetime(2026, 11, 6, 9, 33, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3141da4f-e70d-439b-81af-e22387bd01d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169c248e-952c-4cde-b0e3-405adf9217f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:50 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Volume volume-7060d910-4aac-46df-bffd-c9687e2aa728 (7060d910-4aac-46df-bffd-c9687e2aa728): created successfully Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169c248e-952c-4cde-b0e3-405adf9217f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Flow 'volume_create_manager' (8abb4eaa-eb9e-41c5-a8f1-1aa3a00f8994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:50 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-169d10a9-e325-4a24-a4a7-aa3dbe48a0c9 tempest-VolumesGetTest-2022055069 None] Created volume successfully. Nov 06 10:52:50 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb" returned: 0 in 0.412s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:50 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb 1G Nov 06 10:52:50 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:51 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb 1G" returned: 0 in 0.729s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:51 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb Nov 06 10:52:51 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:51 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb" returned: 0 in 0.473s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:51 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb is being set with open permissions: ugo+rw Nov 06 10:52:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:51 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb Nov 06 10:52:51 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Flow 'volume_create_manager' (6e9a1e5b-1aff-48c1-b58b-4e345ba6733c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49ab46d-d804-464c-b3f2-9ad87156324d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49ab46d-d804-464c-b3f2-9ad87156324d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-775132773',display_name='tempest-VolumesGetTest-Volume-249180177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12798635-8e2e-4efb-af14-c602b8f0bc75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29efbffb1c434d84a3712be762000a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:52Z,use_quota=True,user_id='50c72d45cb084afd9b2a3171dee31a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd3a7f9-1584-41c1-8afa-6c24acfd0b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd3a7f9-1584-41c1-8afa-6c24acfd0b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2bd1fe9-50e0-4fc4-abf3-0ff4b3ef6b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2bd1fe9-50e0-4fc4-abf3-0ff4b3ef6b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12798635-8e2e-4efb-af14-c602b8f0bc75', 'volume_name': 'volume-12798635-8e2e-4efb-af14-c602b8f0bc75', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4761554-347d-426e-aa14-e3992fb50cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4761554-347d-426e-aa14-e3992fb50cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d176c008-cee8-4179-b370-66804c83cc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:52 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Volume 12798635-8e2e-4efb-af14-c602b8f0bc75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12798635-8e2e-4efb-af14-c602b8f0bc75', 'volume_size': 1} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:52 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Flow 'volume_create_manager' (048baf3c-8846-41ba-8aab-98a9fb53d8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931aa9f1-6f4b-4eb5-9e70-86e19896d48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb" returned: 0 in 0.318s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931aa9f1-6f4b-4eb5-9e70-86e19896d48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-549123845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60fb0135-5721-4abb-9d07-a5fd0d775f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b074c7e8fc42709d3b9c3fc9a392bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:52Z,use_quota=True,user_id='8623045873a448bb94fd5e3d06a1d90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e426e0f-b1b3-49ac-acaf-44863c3c0fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e426e0f-b1b3-49ac-acaf-44863c3c0fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7f38df-b942-47a5-9868-75264b90e2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7f38df-b942-47a5-9868-75264b90e2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60fb0135-5721-4abb-9d07-a5fd0d775f24', 'volume_name': 'volume-60fb0135-5721-4abb-9d07-a5fd0d775f24', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c812e0bf-59b2-4a83-afa2-04eaa218706d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c812e0bf-59b2-4a83-afa2-04eaa218706d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4279bc2a-0a47-4f63-9ebd-687d31e4acbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:52 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Volume 60fb0135-5721-4abb-9d07-a5fd0d775f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60fb0135-5721-4abb-9d07-a5fd0d775f24', 'volume_size': 1} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:52 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.info Nov 06 10:52:52 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:52 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.info" returned: 0 in 0.269s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:52 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.info is being set with open permissions: ugo+rw Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:52 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.info Nov 06 10:52:52 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:52 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.info" returned: 0 in 0.265s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.662s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.732s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-775132773',display_name='tempest-VolumesGetTest-Volume-249180177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12798635-8e2e-4efb-af14-c602b8f0bc75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29efbffb1c434d84a3712be762000a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:52Z,use_quota=True,user_id='50c72d45cb084afd9b2a3171dee31a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Creating volume 12798635-8e2e-4efb-af14-c602b8f0bc75 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:52 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-12798635-8e2e-4efb-af14-c602b8f0bc75 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:52 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-12798635-8e2e-4efb-af14-c602b8f0bc75 1073741824 Nov 06 10:52:52 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:52 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-45477b08-c9c0-411b-a03f-c63a9b7bb311 tempest-SnapshotDependencyTests-521457354 None] Create snapshot completed successfully Nov 06 10:52:53 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-12798635-8e2e-4efb-af14-c602b8f0bc75 1073741824" returned: 0 in 0.535s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-12798635-8e2e-4efb-af14-c602b8f0bc75 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:53 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-12798635-8e2e-4efb-af14-c602b8f0bc75 Nov 06 10:52:53 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:53 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-12798635-8e2e-4efb-af14-c602b8f0bc75" returned: 0 in 0.321s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.511s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-549123845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60fb0135-5721-4abb-9d07-a5fd0d775f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b074c7e8fc42709d3b9c3fc9a392bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:52Z,use_quota=True,user_id='8623045873a448bb94fd5e3d06a1d90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Creating volume 60fb0135-5721-4abb-9d07-a5fd0d775f24 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:53 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d176c008-cee8-4179-b370-66804c83cc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12798635-8e2e-4efb-af14-c602b8f0bc75', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:53 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 1073741824 Nov 06 10:52:53 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ae0f01-eb4c-42ee-9e04-d1a9fdf0be75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:53 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Volume volume-12798635-8e2e-4efb-af14-c602b8f0bc75 (12798635-8e2e-4efb-af14-c602b8f0bc75): created successfully Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ae0f01-eb4c-42ee-9e04-d1a9fdf0be75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Flow 'volume_create_manager' (6e9a1e5b-1aff-48c1-b58b-4e345ba6733c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:52:53 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-279c7df1-5a2d-4090-b91d-ba474feb1009 tempest-VolumesGetTest-2022055069 None] Created volume successfully. Nov 06 10:52:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Flow 'volume_create_manager' (922c5f69-2a57-42ad-b9b3-f636f02f2013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ffbe058-5588-4a88-bbe4-d332e6aa2a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ffbe058-5588-4a88-bbe4-d332e6aa2a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25dcbdb-8b93-4f4e-a11b-8bb8f272e930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf78564650246f7abe11cccdc132922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=524af09d-0a00-4b62-ab41-b184efb1cdfb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:52:54Z,use_quota=True,user_id='42b106feb7a14d2793240f85a2d729e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469c527a-8c9d-4376-a0c7-21f220a723eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469c527a-8c9d-4376-a0c7-21f220a723eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6010294-e9c8-43c2-80c3-c682edd7423b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6010294-e9c8-43c2-80c3-c682edd7423b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e25dcbdb-8b93-4f4e-a11b-8bb8f272e930', 'volume_name': 'volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930', 'volume_size': 1, 'snapshot_id': '524af09d-0a00-4b62-ab41-b184efb1cdfb'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6605a44-6d0c-40f8-9559-612490b68c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6605a44-6d0c-40f8-9559-612490b68c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5d5a91-07d4-44d2-aca2-6046f3185f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:54 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Volume e25dcbdb-8b93-4f4e-a11b-8bb8f272e930: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930', 'volume_size': 1, 'snapshot_id': '524af09d-0a00-4b62-ab41-b184efb1cdfb'} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-12798635-8e2e-4efb-af14-c602b8f0bc75-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Lock "cinder-12798635-8e2e-4efb-af14-c602b8f0bc75-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-quobyte-12798635-8e2e-4efb-af14-c602b8f0bc75" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-12798635-8e2e-4efb-af14-c602b8f0bc75" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10e4941-ef72-417d-88a9-201c7773c011]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-12798635-8e2e-4efb-af14-c602b8f0bc75 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:54 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 1073741824" returned: 0 in 0.630s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:54 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 Nov 06 10:52:54 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:54 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-12798635-8e2e-4efb-af14-c602b8f0bc75 Nov 06 10:52:54 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:54 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24" returned: 0 in 0.299s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.659s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "cinder-quobyte-524af09d-0a00-4b62-ab41-b184efb1cdfb-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930" by "_create_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4279bc2a-0a47-4f63-9ebd-687d31e4acbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60fb0135-5721-4abb-9d07-a5fd0d775f24', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e119f96a-3939-449f-b9a8-7af80be7da5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-quobyte-524af09d-0a00-4b62-ab41-b184efb1cdfb-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Creating volume e25dcbdb-8b93-4f4e-a11b-8bb8f272e930 from snapshot 524af09d-0a00-4b62-ab41-b184efb1cdfb {{(pid=86819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "cinder-quobyte-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930" by "_copy_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:54 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:54 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Volume volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 (60fb0135-5721-4abb-9d07-a5fd0d775f24): created successfully Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e119f96a-3939-449f-b9a8-7af80be7da5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Flow 'volume_create_manager' (048baf3c-8846-41ba-8aab-98a9fb53d8b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-quobyte-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] snapshot: 524af09d-0a00-4b62-ab41-b184efb1cdfb, volume: e25dcbdb-8b93-4f4e-a11b-8bb8f272e930, {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-12798635-8e2e-4efb-af14-c602b8f0bc75" returned: 0 in 0.481s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-12798635-8e2e-4efb-af14-c602b8f0bc75 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:54 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-3edacc6c-97a6-4960-acd9-a672e742877a tempest-CinderUnicodeTest-1723306910 None] Created volume successfully. Nov 06 10:52:54 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-12798635-8e2e-4efb-af14-c602b8f0bc75 Nov 06 10:52:54 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4225aa-1408-44de-911c-3e9863d704bb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:55 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb Nov 06 10:52:55 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:55 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-12798635-8e2e-4efb-af14-c602b8f0bc75" returned: 0 in 0.301s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-12798635-8e2e-4efb-af14-c602b8f0bc75" released by "delete_volume" :: held 0.854s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Created reservations ['9a77f5fe-49aa-4c0b-bb0c-ab4a70a372b4', 'e24d391e-5f38-419c-b322-711e894bb9a0', '3c998047-a7c0-4915-9d14-ba632126c5be', '0b70751f-32bc-4934-a884-0bb3ae733a74'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:55 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb" returned: 0 in 0.506s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b105e4b-c1fe-47f2-a7c9-906dd4096c93]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:55 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:55 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:55 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb Nov 06 10:52:55 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:55 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.326s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:55 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Deleted volume successfully. Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-29b83ddf-5fa4-4b1d-90b5-53bf8bffff2d tempest-VolumesGetTest-2022055069 None] Lock "cinder-12798635-8e2e-4efb-af14-c602b8f0bc75-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:55 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb" returned: 0 in 0.440s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] will copy from snapshot at /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Creating direct copy from snapshot {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG cinder.utils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Path /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930 not found in is_blk_device check {{(pid=86819) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 10:52:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:55 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930 Nov 06 10:52:55 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-7060d910-4aac-46df-bffd-c9687e2aa728-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Lock "cinder-7060d910-4aac-46df-bffd-c9687e2aa728-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Acquiring lock "cinder-quobyte-7060d910-4aac-46df-bffd-c9687e2aa728" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:52:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-7060d910-4aac-46df-bffd-c9687e2aa728" acquired by "delete_volume" :: waited 0.034s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:52:56 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0b0f7e-5b4e-4dea-9598-ae9ad73b642d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:52:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:57 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728 Nov 06 10:52:57 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:57 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728" returned: 0 in 0.631s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:57 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728 Nov 06 10:52:57 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:58 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7060d910-4aac-46df-bffd-c9687e2aa728" returned: 0 in 0.462s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Lock "cinder-quobyte-7060d910-4aac-46df-bffd-c9687e2aa728" released by "delete_volume" :: held 1.199s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:52:58 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Created reservations ['36f84038-ca37-44bc-a240-d5c45290e107', 'ebc87e2a-dedf-4612-a9ca-2f79184dcf3e', 'abba482a-0377-4ddf-9de0-0b061e57407d', 'ead0170c-9c14-40ab-bdb7-8b9fa0a5f1df'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:52:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:52:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:52:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:52:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:52:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:52:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:52:58 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:52:58 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:52:59 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Nov 06 10:52:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.671s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:52:59 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:52:59 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Deleted volume successfully. Nov 06 10:52:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-18480b47-0bf8-4053-9675-825c9bf9e644 tempest-VolumesGetTest-2022055069 None] Lock "cinder-7060d910-4aac-46df-bffd-c9687e2aa728-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:04 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930" returned: 0 in 8.836s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:04 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Image conversion details: src /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb, size 1024.00 MB, duration 8.84 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930 {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:53:04 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Converted 1024.00 MB image at 115.87 MB/s Nov 06 10:53:04 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930 is being set with open permissions: ugo+rw Nov 06 10:53:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:04 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930 Nov 06 10:53:04 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:05 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930" returned: 0 in 0.286s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-quobyte-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930" released by "_copy_volume_from_snapshot" :: held 10.211s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-quobyte-524af09d-0a00-4b62-ab41-b184efb1cdfb-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930" released by "_create_volume_from_snapshot" :: held 10.325s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.369s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.436s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] Creating offline snapshot b3b40273-59be-4001-b935-7ddbcdf32837 of volume 60fb0135-5721-4abb-9d07-a5fd0d775f24 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5d5a91-07d4-44d2-aca2-6046f3185f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930', 'volume_size': 1, 'snapshot_id': '524af09d-0a00-4b62-ab41-b184efb1cdfb'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70af6efb-a6b8-4807-a60b-1fe27f3f077f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2c67ad-f9d7-4252-bb38-b30642e2db54]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:05 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Volume volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930 (e25dcbdb-8b93-4f4e-a11b-8bb8f272e930): created successfully Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70af6efb-a6b8-4807-a60b-1fe27f3f077f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Flow 'volume_create_manager' (922c5f69-2a57-42ad-b9b3-f636f02f2013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:53:05 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-74a2f7d2-9674-4edd-bcc0-fd012021ec4f tempest-SnapshotDependencyTests-521457354 None] Created volume successfully. Nov 06 10:53:05 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 Nov 06 10:53:05 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Flow 'volume_create_manager' (e01fd7dc-e552-4b87-97a1-da176e057a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1f6d32-70e5-44d0-946f-56cbada985f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1f6d32-70e5-44d0-946f-56cbada985f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1472635472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903ad1b5-f228-4466-9ddd-214c647e0e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cfcd14433048de8036453ce5d1f01b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:53:06Z,use_quota=True,user_id='22d127b324234bc2affa0ca142bd5dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85c1c8a-beb1-4254-8775-604b31262f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85c1c8a-beb1-4254-8775-604b31262f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae95894f-d295-4ea5-936a-64c1389169ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae95894f-d295-4ea5-936a-64c1389169ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '903ad1b5-f228-4466-9ddd-214c647e0e7e', 'volume_name': 'volume-903ad1b5-f228-4466-9ddd-214c647e0e7e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c3e0e5-e3d5-4888-b93a-1828e112595a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c3e0e5-e3d5-4888-b93a-1828e112595a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba88fa1-774d-427e-9ac7-1a485f9450ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:05 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Volume 903ad1b5-f228-4466-9ddd-214c647e0e7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-903ad1b5-f228-4466-9ddd-214c647e0e7e', 'volume_size': 1} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:05 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24" returned: 0 in 0.520s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:05 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837 1G Nov 06 10:53:05 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "cinder-524af09d-0a00-4b62-ab41-b184efb1cdfb-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:06 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837 1G" returned: 0 in 0.533s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-524af09d-0a00-4b62-ab41-b184efb1cdfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "cinder-quobyte-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:06 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837 Nov 06 10:53:06 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-quobyte-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "cinder-quobyte-524af09d-0a00-4b62-ab41-b184efb1cdfb" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-quobyte-524af09d-0a00-4b62-ab41-b184efb1cdfb" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Deleting offline snapshot 524af09d-0a00-4b62-ab41-b184efb1cdfb of volume a38cba83-5fcf-4ed4-8a7b-c743ac29eceb {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] snapshot_file for this snap is: volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e883a2-d857-4091-8b9e-328d14dca22c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:06 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb Nov 06 10:53:06 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:06 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837" returned: 0 in 0.411s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:06 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837 is being set with open permissions: ugo+rw Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:06 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837 Nov 06 10:53:06 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:06 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb" returned: 0 in 0.450s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b40ed71-23e1-42b4-9f98-fca8f5b26a1f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:07 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837" returned: 0 in 0.307s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:07 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.info Nov 06 10:53:07 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:07 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb Nov 06 10:53:07 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:07 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.info" returned: 0 in 0.305s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:07 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.info is being set with open permissions: ugo+rw Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:07 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.info Nov 06 10:53:07 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:07 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb" returned: 0 in 0.671s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:07 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb Nov 06 10:53:07 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:07 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.info" returned: 0 in 0.375s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.598s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.030s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1472635472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903ad1b5-f228-4466-9ddd-214c647e0e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cfcd14433048de8036453ce5d1f01b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:53:06Z,use_quota=True,user_id='22d127b324234bc2affa0ca142bd5dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Creating volume 903ad1b5-f228-4466-9ddd-214c647e0e7e {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:53:07 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:53:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:07 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ad06ef42-5b6d-48ae-94f9-6795783f2dbe tempest-CinderUnicodeTest-1723306910 None] Create snapshot completed successfully Nov 06 10:53:07 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e 1073741824 Nov 06 10:53:07 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:08 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb" returned: 0 in 0.490s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:08 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb Nov 06 10:53:08 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:08 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e 1073741824" returned: 0 in 0.613s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:08 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb.524af09d-0a00-4b62-ab41-b184efb1cdfb" returned: 0 in 0.377s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:08 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e Nov 06 10:53:08 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-quobyte-524af09d-0a00-4b62-ab41-b184efb1cdfb" released by "_delete_snapshot" :: held 2.204s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-quobyte-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb" released by "delete_snapshot" :: held 2.256s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Acquiring lock "cinder-b3b40273-59be-4001-b935-7ddbcdf32837-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Created reservations ['d69a93e7-30c3-40eb-bc71-6f7b87969871', '37b0a1a7-14c8-433a-9530-f0a4165faf02', '013c06e7-a843-4f2b-a904-fa562aae86c0', '2d36ef82-c6f6-4a10-a6db-d840b1a1c33c'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Lock "cinder-b3b40273-59be-4001-b935-7ddbcdf32837-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Acquiring lock "cinder-quobyte-60fb0135-5721-4abb-9d07-a5fd0d775f24" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Lock "cinder-quobyte-60fb0135-5721-4abb-9d07-a5fd0d775f24" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Acquiring lock "cinder-quobyte-b3b40273-59be-4001-b935-7ddbcdf32837" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Lock "cinder-quobyte-b3b40273-59be-4001-b935-7ddbcdf32837" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Deleting offline snapshot b3b40273-59be-4001-b935-7ddbcdf32837 of volume 60fb0135-5721-4abb-9d07-a5fd0d775f24 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] snapshot_file for this snap is: volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[db14a31b-86ec-461c-99af-f5ff83a05504]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:08 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Delete snapshot completed successfully. Nov 06 10:53:08 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e" returned: 0 in 0.461s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3f447dae-ff68-491b-ae24-3ba9e420a1c3 tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-524af09d-0a00-4b62-ab41-b184efb1cdfb-delete_snapshot" released by "delete_snapshot" :: held 2.647s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba88fa1-774d-427e-9ac7-1a485f9450ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903ad1b5-f228-4466-9ddd-214c647e0e7e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:08 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9976b3-fbc9-4c28-99b7-635343b6b6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:09 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Volume volume-903ad1b5-f228-4466-9ddd-214c647e0e7e (903ad1b5-f228-4466-9ddd-214c647e0e7e): created successfully Nov 06 10:53:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9976b3-fbc9-4c28-99b7-635343b6b6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Flow 'volume_create_manager' (e01fd7dc-e552-4b87-97a1-da176e057a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:53:09 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-8a7a8afc-9545-4431-ac74-7f7a5b620a9d tempest-TestStampPattern-2028267074 None] Created volume successfully. Nov 06 10:53:09 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837 Nov 06 10:53:09 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:09 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837" returned: 0 in 0.538s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60fb0135-5721-4abb-9d07-a5fd0d775f24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:53:09 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0950d6a0-f79e-43f7-a03b-6bad0e0a79c6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:09 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "cinder-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:09 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:09 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "cinder-quobyte-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:09 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 Nov 06 10:53:09 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:09 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-quobyte-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:09 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2681b4f-5d8c-4d50-9fe2-b4861a755b59]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:09 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb Nov 06 10:53:09 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:10 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24" returned: 0 in 0.547s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:10 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837 Nov 06 10:53:10 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:10 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb" returned: 0 in 0.495s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:10 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb Nov 06 10:53:10 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:10 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837" returned: 0 in 0.476s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:10 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837 Nov 06 10:53:10 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:10 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb" returned: 0 in 0.338s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-quobyte-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb" released by "delete_volume" :: held 0.931s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Created reservations ['dbabf790-5d2e-4781-a3b2-b373d41647ab', 'fe663db6-cb84-4081-8087-bdcedbacd2c4', '064bc515-5371-4970-9c64-075ef019a523', '2afa55a1-2771-4835-ad2b-6ed527af0aea'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:10 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24.b3b40273-59be-4001-b935-7ddbcdf32837" returned: 0 in 0.348s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:10 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:53:10 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Lock "cinder-quobyte-b3b40273-59be-4001-b935-7ddbcdf32837" released by "_delete_snapshot" :: held 2.103s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Lock "cinder-quobyte-60fb0135-5721-4abb-9d07-a5fd0d775f24" released by "delete_snapshot" :: held 2.162s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:11 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Created reservations ['680e95a4-c4a6-4fae-a321-6569ff89197e', '31d41ef0-1154-4b14-8504-e338ae385cb0', 'e9e4c96e-1f6e-4cbe-9e26-225bdf197207', '23f35ba2-1c10-47bd-bed6-223bcc5474f2'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:53:11 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Delete snapshot completed successfully. Nov 06 10:53:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cfdaf6b7-efc7-417f-a497-49b0420c37bd tempest-CinderUnicodeTest-1723306910 None] Lock "cinder-b3b40273-59be-4001-b935-7ddbcdf32837-delete_snapshot" released by "delete_snapshot" :: held 2.338s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:11 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.294s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:11 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:53:11 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Deleted volume successfully. Nov 06 10:53:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8897919a-a01a-4a14-adbe-c7496b4418e2 tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-a38cba83-5fcf-4ed4-8a7b-c743ac29eceb-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "cinder-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Acquiring lock "cinder-60fb0135-5721-4abb-9d07-a5fd0d775f24-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Lock "cinder-60fb0135-5721-4abb-9d07-a5fd0d775f24-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "cinder-quobyte-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Acquiring lock "cinder-quobyte-60fb0135-5721-4abb-9d07-a5fd0d775f24" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-quobyte-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930" acquired by "delete_volume" :: waited 0.025s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Lock "cinder-quobyte-60fb0135-5721-4abb-9d07-a5fd0d775f24" acquired by "delete_volume" :: waited 0.035s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[29284f14-a197-4796-94ac-7f10c97a2e6f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9fc725-a89c-4423-b5da-9dc7afdf35c0]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:12 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930 Nov 06 10:53:12 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:12 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 Nov 06 10:53:12 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:12 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930" returned: 0 in 0.442s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:12 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930 Nov 06 10:53:12 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:12 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24" returned: 0 in 0.575s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:12 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24 Nov 06 10:53:12 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:12 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930" returned: 0 in 0.337s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-quobyte-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930" released by "delete_volume" :: held 0.871s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:12 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=143,cinder:SELECT=114,cinder:INSERT=42,cinder:DELETE=9 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Created reservations ['a3d8ddfe-ad31-4465-8577-fad649e33464', 'f8dde19b-0752-4f97-809d-7c5055a472bb', 'b7966f9c-fa6c-44a1-9aed-30d8f517dcc1', '40e454d1-a69e-44c5-b9f8-6348c66c58aa'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:53:13 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-60fb0135-5721-4abb-9d07-a5fd0d775f24" returned: 0 in 0.399s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Lock "cinder-quobyte-60fb0135-5721-4abb-9d07-a5fd0d775f24" released by "delete_volume" :: held 1.076s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:13 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:53:13 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Created reservations ['7a6b9a36-fe3e-41ec-bf2a-3c2480743182', '7a5fd597-32f1-4607-8e31-8d23e23e1152', 'ae277662-dc71-4aed-83b3-7731cdd190db', '3ff2799d-4e7b-4b0a-a66d-db19c89a2f04'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:13 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:53:13 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:13 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.343s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:53:13 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Deleted volume successfully. Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c41a92d2-86a9-4c61-acc5-4f45c62f571a tempest-SnapshotDependencyTests-521457354 None] Lock "cinder-e25dcbdb-8b93-4f4e-a11b-8bb8f272e930-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:13 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.320s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:53:13 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Deleted volume successfully. Nov 06 10:53:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d950934e-ec72-4c52-8806-476ba9dae742 tempest-CinderUnicodeTest-1723306910 None] Lock "cinder-60fb0135-5721-4abb-9d07-a5fd0d775f24-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Acquiring lock "cinder-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Lock "cinder-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Acquiring lock "cinder-quobyte-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Lock "cinder-quobyte-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87" acquired by "delete_volume" :: waited 0.028s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:14 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8e769c-ed5c-4eba-9251-0282452d33e4]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:14 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87 Nov 06 10:53:14 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:15 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87" returned: 0 in 0.764s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:15 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87 Nov 06 10:53:15 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:15 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87" returned: 0 in 0.398s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:15 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Lock "cinder-quobyte-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87" released by "delete_volume" :: held 1.241s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:16 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Created reservations ['0ae78af3-44d1-457f-bd38-ef40323c6c3a', '1d0fecb4-458c-4a4c-b4c8-a0886060c4ee', '0bb8c5ce-6a9c-46c1-a861-70d429a6be54', '587b0900-ea95-4d2a-b23f-37496cbe0a39'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:53:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:53:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:53:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:16 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:53:16 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:16 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.411s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:16 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:53:16 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Deleted volume successfully. Nov 06 10:53:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-529120e9-4614-4a87-a52a-8a2331620915 tempest-CinderUnicodeTest-1723306910 None] Lock "cinder-3a6ccbe2-95b6-4f36-98b2-cc6b5b291a87-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Flow 'volume_create_manager' (16eb6d9d-67a5-4476-85c2-b6c8455ef1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e83631-8cc4-4bc6-9746-2b5c5bfaed38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e83631-8cc4-4bc6-9746-2b5c5bfaed38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1809288395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233140e9-3219-4e76-9d37-4850b7c3cb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4da3994dfa342128a91c7b3888167cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:53:20Z,use_quota=True,user_id='ec4160f2b161453e982d69ff83ba8307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148f1af8-ce18-48f4-b068-e930ee58edd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148f1af8-ce18-48f4-b068-e930ee58edd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e634f5-8e44-42c0-90f6-a58dfc878db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e634f5-8e44-42c0-90f6-a58dfc878db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '233140e9-3219-4e76-9d37-4850b7c3cb66', 'volume_name': 'volume-233140e9-3219-4e76-9d37-4850b7c3cb66', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9404e9cc-20e6-41bd-a5d0-4d1905a8253a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9404e9cc-20e6-41bd-a5d0-4d1905a8253a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242473ed-a156-4820-a03c-5fd6d85191c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:19 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Volume 233140e9-3219-4e76-9d37-4850b7c3cb66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-233140e9-3219-4e76-9d37-4850b7c3cb66', 'volume_size': 1} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1809288395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233140e9-3219-4e76-9d37-4850b7c3cb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4da3994dfa342128a91c7b3888167cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:53:20Z,use_quota=True,user_id='ec4160f2b161453e982d69ff83ba8307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Creating volume 233140e9-3219-4e76-9d37-4850b7c3cb66 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:53:19 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:53:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:20 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66 1073741824 Nov 06 10:53:20 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:20 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66 1073741824" returned: 0 in 0.709s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:20 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66 Nov 06 10:53:20 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:21 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66" returned: 0 in 0.411s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:53:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242473ed-a156-4820-a03c-5fd6d85191c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-233140e9-3219-4e76-9d37-4850b7c3cb66', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a132a6-d5bb-48fb-9f28-7e643b0e5969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:21 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Volume volume-233140e9-3219-4e76-9d37-4850b7c3cb66 (233140e9-3219-4e76-9d37-4850b7c3cb66): created successfully Nov 06 10:53:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a132a6-d5bb-48fb-9f28-7e643b0e5969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Flow 'volume_create_manager' (16eb6d9d-67a5-4476-85c2-b6c8455ef1b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:53:21 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9cabc061-9312-41a4-bc37-40f0f978705e tempest-VolumesSnapshotTestJSON-1594272062 None] Created volume successfully. Nov 06 10:53:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] Creating offline snapshot 54162361-cf25-436b-8540-63906278fc51 of volume 233140e9-3219-4e76-9d37-4850b7c3cb66 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:53:22 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64e9326-7a33-4df4-9b0d-1aa3c957fc80]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:22 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66 Nov 06 10:53:22 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:23 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66" returned: 0 in 0.532s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:23 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51 1G Nov 06 10:53:23 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:23 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51 1G" returned: 0 in 0.695s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-233140e9-3219-4e76-9d37-4850b7c3cb66 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:24 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-233140e9-3219-4e76-9d37-4850b7c3cb66 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51 Nov 06 10:53:24 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:24 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-233140e9-3219-4e76-9d37-4850b7c3cb66 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51" returned: 0 in 0.516s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:24 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51 is being set with open permissions: ugo+rw Nov 06 10:53:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:24 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51 Nov 06 10:53:24 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:24 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51" returned: 0 in 0.487s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:25 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.info Nov 06 10:53:25 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:25 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.info" returned: 0 in 0.573s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:25 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.info is being set with open permissions: ugo+rw Nov 06 10:53:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:25 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.info Nov 06 10:53:25 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:25 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.info" returned: 0 in 0.340s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.317s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:26 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a6070ed3-9c6d-43df-b66b-03604da858fd tempest-VolumesSnapshotTestJSON-1594272062 None] Create snapshot completed successfully Nov 06 10:53:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-54162361-cf25-436b-8540-63906278fc51-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-54162361-cf25-436b-8540-63906278fc51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-quobyte-233140e9-3219-4e76-9d37-4850b7c3cb66" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-233140e9-3219-4e76-9d37-4850b7c3cb66" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-quobyte-54162361-cf25-436b-8540-63906278fc51" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-54162361-cf25-436b-8540-63906278fc51" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Deleting offline snapshot 54162361-cf25-436b-8540-63906278fc51 of volume 233140e9-3219-4e76-9d37-4850b7c3cb66 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:53:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] snapshot_file for this snap is: volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:53:27 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[af80f4ff-bf63-41ed-805d-760a1edf43da]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:27 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51 Nov 06 10:53:27 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:27 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51" returned: 0 in 0.509s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-233140e9-3219-4e76-9d37-4850b7c3cb66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:53:28 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e88c9b3-f3d1-44c7-9ebe-858146e0c5e2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:28 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66 Nov 06 10:53:28 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:28 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66" returned: 0 in 0.575s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:28 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51 Nov 06 10:53:28 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:29 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51" returned: 0 in 0.586s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:29 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51 Nov 06 10:53:29 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:29 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66.54162361-cf25-436b-8540-63906278fc51" returned: 0 in 0.327s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:29 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=118,cinder:UPDATE=122,cinder:DELETE=13,cinder:INSERT=46 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:53:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-54162361-cf25-436b-8540-63906278fc51" released by "_delete_snapshot" :: held 2.166s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-233140e9-3219-4e76-9d37-4850b7c3cb66" released by "delete_snapshot" :: held 2.201s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:29 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Created reservations ['b8c730aa-6731-4fe9-9196-44161e0874e5', 'dc5c257b-98d2-47f6-96aa-bcfadfd4d664', '0e827ca3-5e7a-4e4f-9d9f-8d8d429a2b80', 'a6602f3e-f092-4118-8e45-2fd9228e2110'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:53:29 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Delete snapshot completed successfully. Nov 06 10:53:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cb46f9da-d456-438e-baca-5d1e1734dd5d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-54162361-cf25-436b-8540-63906278fc51-delete_snapshot" released by "delete_snapshot" :: held 2.458s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Flow 'volume_create_manager' (31ea1856-27ca-4f78-bfe4-e3f3729c9453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a80786-bb6c-41b1-add0-3f4431d9ce71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a80786-bb6c-41b1-add0-3f4431d9ce71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2043265548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4da3994dfa342128a91c7b3888167cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:53:31Z,use_quota=True,user_id='ec4160f2b161453e982d69ff83ba8307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff774f1-af03-4c8e-bbf5-e416b1df2f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff774f1-af03-4c8e-bbf5-e416b1df2f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715b07f2-82b4-479d-bc9c-b33f34ad56dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715b07f2-82b4-479d-bc9c-b33f34ad56dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b', 'volume_name': 'volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e59dbd-142c-47b5-bfb2-481d59e23fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e59dbd-142c-47b5-bfb2-481d59e23fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d62450-40a8-4836-b378-2df177f0e148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:31 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Volume f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b', 'volume_size': 1} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2043265548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4da3994dfa342128a91c7b3888167cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:53:31Z,use_quota=True,user_id='ec4160f2b161453e982d69ff83ba8307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Creating volume f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:53:31 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:31 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b 1073741824 Nov 06 10:53:31 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:31 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b 1073741824" returned: 0 in 0.554s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:31 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b Nov 06 10:53:31 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:32 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b" returned: 0 in 0.301s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:53:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d62450-40a8-4836-b378-2df177f0e148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d10e9bc-9419-4ab1-895a-aba55b386365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:32 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Volume volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b (f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b): created successfully Nov 06 10:53:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d10e9bc-9419-4ab1-895a-aba55b386365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Flow 'volume_create_manager' (31ea1856-27ca-4f78-bfe4-e3f3729c9453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:53:32 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-6ce89d94-3493-4384-b59e-d53ada26f8d6 tempest-VolumesSnapshotTestJSON-1594272062 None] Created volume successfully. Nov 06 10:53:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] Creating offline snapshot 5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 of volume f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:53:33 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c694a59b-d82d-4b68-9a10-b73324d7d60f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:33 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b Nov 06 10:53:33 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:34 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b" returned: 0 in 0.400s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:34 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 1G Nov 06 10:53:34 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:34 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 1G" returned: 0 in 0.431s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:34 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 Nov 06 10:53:34 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:34 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95" returned: 0 in 0.299s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:34 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 is being set with open permissions: ugo+rw Nov 06 10:53:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:34 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 Nov 06 10:53:34 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:34 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95" returned: 0 in 0.251s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:35 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.info Nov 06 10:53:35 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:35 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.info" returned: 0 in 0.247s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:35 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.info is being set with open permissions: ugo+rw Nov 06 10:53:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:35 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.info Nov 06 10:53:35 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:35 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.info" returned: 0 in 0.246s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:35 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-680dd304-67bb-468d-a6a3-a7ff23aa5887 tempest-VolumesSnapshotTestJSON-1594272062 None] Create snapshot completed successfully Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:53:36 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:53:36 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Flow 'volume_create_manager' (be527ed2-f152-43cc-b277-8c20c84cadde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e9d3af-d20b-4030-8149-a7aa6604c39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e9d3af-d20b-4030-8149-a7aa6604c39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-574431323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8b5493-cb7c-4c2e-907a-025fb8906678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4da3994dfa342128a91c7b3888167cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:53:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5235fa81-1bd5-4bca-9d1c-80a5f72e1f95,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:53:36Z,use_quota=True,user_id='ec4160f2b161453e982d69ff83ba8307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d03cb4-a375-4c27-b551-aed8583cee8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d03cb4-a375-4c27-b551-aed8583cee8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bf4ef0-95b1-43eb-b029-d2b40556d8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bf4ef0-95b1-43eb-b029-d2b40556d8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca8b5493-cb7c-4c2e-907a-025fb8906678', 'volume_name': 'volume-ca8b5493-cb7c-4c2e-907a-025fb8906678', 'volume_size': 2, 'snapshot_id': '5235fa81-1bd5-4bca-9d1c-80a5f72e1f95'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c006220-e1a8-49a6-9b49-d2af4a8637c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c006220-e1a8-49a6-9b49-d2af4a8637c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab9f8c3-0228-4ca9-a941-6a381fb9b799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:36 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Volume ca8b5493-cb7c-4c2e-907a-025fb8906678: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca8b5493-cb7c-4c2e-907a-025fb8906678', 'volume_size': 2, 'snapshot_id': '5235fa81-1bd5-4bca-9d1c-80a5f72e1f95'} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-quobyte-5235fa81-1bd5-4bca-9d1c-80a5f72e1f95-ca8b5493-cb7c-4c2e-907a-025fb8906678" by "_create_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-5235fa81-1bd5-4bca-9d1c-80a5f72e1f95-ca8b5493-cb7c-4c2e-907a-025fb8906678" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Creating volume ca8b5493-cb7c-4c2e-907a-025fb8906678 from snapshot 5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 {{(pid=86819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-quobyte-ca8b5493-cb7c-4c2e-907a-025fb8906678" by "_copy_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-ca8b5493-cb7c-4c2e-907a-025fb8906678" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] snapshot: 5235fa81-1bd5-4bca-9d1c-80a5f72e1f95, volume: ca8b5493-cb7c-4c2e-907a-025fb8906678, {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[446f28f6-4283-4754-a959-f95ad094dfc6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:36 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.271s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 29 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:53:36 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 Nov 06 10:53:36 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:36 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95" returned: 0 in 0.390s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b2242f-3d45-4d4c-90f5-3f370c9240c7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:36 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b Nov 06 10:53:36 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:37 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b" returned: 0 in 0.384s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] will copy from snapshot at /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 10:53:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Creating direct copy from snapshot {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 10:53:37 devstack cinder-volume[86819]: DEBUG cinder.utils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Path /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ca8b5493-cb7c-4c2e-907a-025fb8906678 not found in is_blk_device check {{(pid=86819) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 10:53:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ca8b5493-cb7c-4c2e-907a-025fb8906678 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:37 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ca8b5493-cb7c-4c2e-907a-025fb8906678 Nov 06 10:53:37 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-24c626da-b9df-45fd-b2cf-ad948921381b req-992258f8-b3b5-45d2-9a4c-1e3d1cee8f6a tempest-TestStampPattern-2028267074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:43 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ca8b5493-cb7c-4c2e-907a-025fb8906678" returned: 0 in 6.330s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:43 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Image conversion details: src /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ca8b5493-cb7c-4c2e-907a-025fb8906678 {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:53:43 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Converted 1024.00 MB image at 161.73 MB/s Nov 06 10:53:43 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ca8b5493-cb7c-4c2e-907a-025fb8906678 is being set with open permissions: ugo+rw Nov 06 10:53:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ca8b5493-cb7c-4c2e-907a-025fb8906678 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:43 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ca8b5493-cb7c-4c2e-907a-025fb8906678 Nov 06 10:53:43 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:43 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ca8b5493-cb7c-4c2e-907a-025fb8906678" returned: 0 in 0.239s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:43 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-ca8b5493-cb7c-4c2e-907a-025fb8906678" released by "_copy_volume_from_snapshot" :: held 7.454s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:43 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-5235fa81-1bd5-4bca-9d1c-80a5f72e1f95-ca8b5493-cb7c-4c2e-907a-025fb8906678" released by "_create_volume_from_snapshot" :: held 7.521s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.539s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-24c626da-b9df-45fd-b2cf-ad948921381b req-992258f8-b3b5-45d2-9a4c-1e3d1cee8f6a tempest-TestStampPattern-2028267074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.932s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-24c626da-b9df-45fd-b2cf-ad948921381b req-992258f8-b3b5-45d2-9a4c-1e3d1cee8f6a tempest-TestStampPattern-2028267074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab9f8c3-0228-4ca9-a941-6a381fb9b799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca8b5493-cb7c-4c2e-907a-025fb8906678', 'volume_size': 2, 'snapshot_id': '5235fa81-1bd5-4bca-9d1c-80a5f72e1f95'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b25da6d-eef2-4ee7-af22-d98476273e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:43 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Volume volume-ca8b5493-cb7c-4c2e-907a-025fb8906678 (ca8b5493-cb7c-4c2e-907a-025fb8906678): created successfully Nov 06 10:53:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b25da6d-eef2-4ee7-af22-d98476273e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Flow 'volume_create_manager' (be527ed2-f152-43cc-b277-8c20c84cadde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:53:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-24c626da-b9df-45fd-b2cf-ad948921381b req-992258f8-b3b5-45d2-9a4c-1e3d1cee8f6a tempest-TestStampPattern-2028267074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-903ad1b5-f228-4466-9ddd-214c647e0e7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1c6ec76-a45b-4316-aa15-a337c518b875', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:53:43 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7075f22c-4fa8-4346-ad58-4185ec58968d tempest-VolumesSnapshotTestJSON-1594272062 None] Created volume successfully. Nov 06 10:53:43 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-24c626da-b9df-45fd-b2cf-ad948921381b req-992258f8-b3b5-45d2-9a4c-1e3d1cee8f6a tempest-TestStampPattern-2028267074 None] attachment_update completed successfully. Nov 06 10:53:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-ca8b5493-cb7c-4c2e-907a-025fb8906678-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-ca8b5493-cb7c-4c2e-907a-025fb8906678-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-quobyte-ca8b5493-cb7c-4c2e-907a-025fb8906678" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-ca8b5493-cb7c-4c2e-907a-025fb8906678" acquired by "delete_volume" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b72f8b4-4615-41a2-8434-b0c972930eeb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ca8b5493-cb7c-4c2e-907a-025fb8906678 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:45 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ca8b5493-cb7c-4c2e-907a-025fb8906678 Nov 06 10:53:45 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:45 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ca8b5493-cb7c-4c2e-907a-025fb8906678" returned: 0 in 0.362s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ca8b5493-cb7c-4c2e-907a-025fb8906678 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:45 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ca8b5493-cb7c-4c2e-907a-025fb8906678 Nov 06 10:53:45 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:45 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ca8b5493-cb7c-4c2e-907a-025fb8906678" returned: 0 in 0.246s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-ca8b5493-cb7c-4c2e-907a-025fb8906678" released by "delete_volume" :: held 0.649s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Created reservations ['1771bc73-33b8-4524-a91f-5ab6be6a0e6c', '0dbe5d00-c0cd-45a4-9c6b-b7f1ef347e9b', 'ca2e54b8-2a71-4211-81be-4a551a30df99', '0730f138-5deb-422b-b091-e6292b25c546'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:45 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:53:45 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:46 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.242s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:53:46 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Deleted volume successfully. Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e67104d2-9644-4bf9-b472-2fc59a82567e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-ca8b5493-cb7c-4c2e-907a-025fb8906678-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-5235fa81-1bd5-4bca-9d1c-80a5f72e1f95-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-5235fa81-1bd5-4bca-9d1c-80a5f72e1f95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-quobyte-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-quobyte-5235fa81-1bd5-4bca-9d1c-80a5f72e1f95" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-5235fa81-1bd5-4bca-9d1c-80a5f72e1f95" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Deleting offline snapshot 5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 of volume f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] snapshot_file for this snap is: volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b9a8e5-c2b3-48de-b568-e2e5676629a4]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:46 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 Nov 06 10:53:46 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:46 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95" returned: 0 in 0.382s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9b8a57-0762-44b4-b68c-558a0d075eff]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:46 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b Nov 06 10:53:46 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:47 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b" returned: 0 in 0.549s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:47 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 Nov 06 10:53:47 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:47 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95" returned: 0 in 0.346s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:47 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95 Nov 06 10:53:47 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:47 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b.5235fa81-1bd5-4bca-9d1c-80a5f72e1f95" returned: 0 in 0.246s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-5235fa81-1bd5-4bca-9d1c-80a5f72e1f95" released by "_delete_snapshot" :: held 1.648s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b" released by "delete_snapshot" :: held 1.685s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:47 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Created reservations ['9a849c9b-6cfc-4e19-a94c-8b86ec31d850', 'f13766b9-bc47-425a-a48e-9c0dffe28016', 'e3c3cee6-dca4-429c-9f18-cbb1f2d269d4', '4cd6b976-e08c-4d6d-b7c7-e66f2687c928'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:53:48 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Delete snapshot completed successfully. Nov 06 10:53:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-979935bd-844e-415e-ba6b-b90f91477fa3 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-5235fa81-1bd5-4bca-9d1c-80a5f72e1f95-delete_snapshot" released by "delete_snapshot" :: held 1.812s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-quobyte-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b" acquired by "delete_volume" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:48 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d293d417-fe17-4783-96a8-e919b68060e5]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:48 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b Nov 06 10:53:48 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:48 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b" returned: 0 in 0.398s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:48 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b Nov 06 10:53:48 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:49 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b" returned: 0 in 0.288s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b" released by "delete_volume" :: held 0.763s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:49 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-c1067f9f-da9d-4406-9941-0e1925f38322 req-be34e2d5-919c-45a3-9b77-089401e9517b tempest-TestStampPattern-2028267074 None] Terminate volume connection completed successfully. Nov 06 10:53:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-c1067f9f-da9d-4406-9941-0e1925f38322 req-be34e2d5-919c-45a3-9b77-089401e9517b tempest-TestStampPattern-2028267074 None] Deleting attachment c1c6ec76-a45b-4316-aa15-a337c518b875. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:53:49 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Created reservations ['b13485ff-5468-4943-bdc6-a6eff5c8d995', 'b4a72f14-d0be-41d9-95fe-f2634f54ef8b', '308d736b-a328-4a23-ba92-33f485698ebe', 'c4182303-bccb-4683-b0e0-c0c66129f1f8'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:53:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:53:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:53:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:49 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:53:49 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:49 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.256s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:49 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:53:49 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Deleted volume successfully. Nov 06 10:53:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b9e7b35f-4a76-44b0-8e37-5f1483ffa88b tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-f94f5c64-dd62-4ec4-97d9-f0b6cbd9c72b-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Flow 'volume_create_manager' (e45af820-152a-4346-82c4-0d3231dbf8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e294f94-bd8d-45ab-a6b8-e2efa3af3d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e294f94-bd8d-45ab-a6b8-e2efa3af3d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1525721636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6977edbb-5bdb-413c-a0c0-c1a3d947f7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4da3994dfa342128a91c7b3888167cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:53:50Z,use_quota=True,user_id='ec4160f2b161453e982d69ff83ba8307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99994a39-99d2-4f3e-83da-c16ac533797e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99994a39-99d2-4f3e-83da-c16ac533797e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f66afbf-ff58-431f-ae8a-9d06f98b4add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f66afbf-ff58-431f-ae8a-9d06f98b4add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6977edbb-5bdb-413c-a0c0-c1a3d947f7c1', 'volume_name': 'volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c28ef76-8180-4a3b-98b0-a84b49edd1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c28ef76-8180-4a3b-98b0-a84b49edd1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e5a02c-ff6a-469a-8dc3-7dda5a66e727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:50 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Volume 6977edbb-5bdb-413c-a0c0-c1a3d947f7c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1', 'volume_size': 1} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1525721636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6977edbb-5bdb-413c-a0c0-c1a3d947f7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4da3994dfa342128a91c7b3888167cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:53:50Z,use_quota=True,user_id='ec4160f2b161453e982d69ff83ba8307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Creating volume 6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:53:50 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:50 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 1073741824 Nov 06 10:53:50 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:50 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 1073741824" returned: 0 in 0.424s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:50 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 Nov 06 10:53:50 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:50 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1" returned: 0 in 0.238s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.660s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e5a02c-ff6a-469a-8dc3-7dda5a66e727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fdafc3-d010-4688-9b92-4fe299fe16c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] Creating offline snapshot 48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 of volume 903ad1b5-f228-4466-9ddd-214c647e0e7e {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:53:50 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Volume volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 (6977edbb-5bdb-413c-a0c0-c1a3d947f7c1): created successfully Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fdafc3-d010-4688-9b92-4fe299fe16c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Flow 'volume_create_manager' (e45af820-152a-4346-82c4-0d3231dbf8c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[491395c7-6381-430d-a156-f6f75612b0f1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:50 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-1b71972d-e6f6-4e64-bf22-7a0a350b599f tempest-VolumesSnapshotTestJSON-1594272062 None] Created volume successfully. Nov 06 10:53:51 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e Nov 06 10:53:51 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:51 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e" returned: 0 in 0.384s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:51 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 1G Nov 06 10:53:51 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:51 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 1G" returned: 0 in 0.386s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-903ad1b5-f228-4466-9ddd-214c647e0e7e -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:51 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-903ad1b5-f228-4466-9ddd-214c647e0e7e -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 Nov 06 10:53:51 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:52 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-903ad1b5-f228-4466-9ddd-214c647e0e7e -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4" returned: 0 in 0.282s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:52 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 is being set with open permissions: ugo+rw Nov 06 10:53:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:52 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 Nov 06 10:53:52 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:52 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4" returned: 0 in 0.236s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:52 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.info Nov 06 10:53:52 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:52 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.info" returned: 0 in 0.244s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:52 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.info is being set with open permissions: ugo+rw Nov 06 10:53:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:52 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.info Nov 06 10:53:52 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:52 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.info" returned: 0 in 0.248s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.494s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] Creating offline snapshot 4be328f2-b4cf-4211-86fa-0656387497ee of volume 6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:53:52 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a4925590-092c-48e2-9d71-3c405dda4d3f tempest-TestStampPattern-2028267074 None] Create snapshot completed successfully Nov 06 10:53:52 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[67762207-565c-49f3-b450-14a5fcba59b7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:52 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 Nov 06 10:53:52 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:53 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1" returned: 0 in 0.360s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:53 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee 1G Nov 06 10:53:53 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:53 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee 1G" returned: 0 in 0.431s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:53 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee Nov 06 10:53:53 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:53 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee" returned: 0 in 0.306s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:53 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee is being set with open permissions: ugo+rw Nov 06 10:53:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:53 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee Nov 06 10:53:53 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:54 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee" returned: 0 in 0.264s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:54 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.info Nov 06 10:53:54 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:54 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.info" returned: 0 in 0.286s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:54 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.info is being set with open permissions: ugo+rw Nov 06 10:53:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:54 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.info Nov 06 10:53:54 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:54 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.info" returned: 0 in 0.276s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:54 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c2542bb9-e961-4ef0-b177-c89e9fd98d56 tempest-VolumesSnapshotTestJSON-1594272062 None] Create snapshot completed successfully Nov 06 10:53:55 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Flow 'volume_create_manager' (5bf4de5a-120a-412d-bdcb-b522e23f02f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50868d75-54fe-4985-8804-acd7545c5c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50868d75-54fe-4985-8804-acd7545c5c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-775679016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13a00f4-7853-4a71-88d2-5145a77d3338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4da3994dfa342128a91c7b3888167cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4be328f2-b4cf-4211-86fa-0656387497ee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:53:56Z,use_quota=True,user_id='ec4160f2b161453e982d69ff83ba8307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e405ee-bfe5-4365-b17a-e2792a81e08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e405ee-bfe5-4365-b17a-e2792a81e08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90e6513-e34c-47a4-8fd7-e0ea92274f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90e6513-e34c-47a4-8fd7-e0ea92274f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f13a00f4-7853-4a71-88d2-5145a77d3338', 'volume_name': 'volume-f13a00f4-7853-4a71-88d2-5145a77d3338', 'volume_size': 1, 'snapshot_id': '4be328f2-b4cf-4211-86fa-0656387497ee'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7665cfd-880f-4ea7-bd5f-5981d4a76bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7665cfd-880f-4ea7-bd5f-5981d4a76bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f73dff-ffcb-4c0a-9142-fcbf4a07ad61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:53:56 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Volume f13a00f4-7853-4a71-88d2-5145a77d3338: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f13a00f4-7853-4a71-88d2-5145a77d3338', 'volume_size': 1, 'snapshot_id': '4be328f2-b4cf-4211-86fa-0656387497ee'} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-quobyte-4be328f2-b4cf-4211-86fa-0656387497ee-f13a00f4-7853-4a71-88d2-5145a77d3338" by "_create_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-4be328f2-b4cf-4211-86fa-0656387497ee-f13a00f4-7853-4a71-88d2-5145a77d3338" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Creating volume f13a00f4-7853-4a71-88d2-5145a77d3338 from snapshot 4be328f2-b4cf-4211-86fa-0656387497ee {{(pid=86819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-quobyte-f13a00f4-7853-4a71-88d2-5145a77d3338" by "_copy_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-f13a00f4-7853-4a71-88d2-5145a77d3338" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] snapshot: 4be328f2-b4cf-4211-86fa-0656387497ee, volume: f13a00f4-7853-4a71-88d2-5145a77d3338, {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fad429c-93a6-4970-8dc7-bef3d2d39719]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:56 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee Nov 06 10:53:56 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:56 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee" returned: 0 in 0.384s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6374983-c852-4d47-bb54-b865be4c3219]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:53:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:56 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 Nov 06 10:53:56 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:53:57 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Nov 06 10:53:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1" returned: 0 in 0.423s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:53:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] will copy from snapshot at /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 10:53:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Creating direct copy from snapshot {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 10:53:57 devstack cinder-volume[86819]: DEBUG cinder.utils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Path /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f13a00f4-7853-4a71-88d2-5145a77d3338 not found in is_blk_device check {{(pid=86819) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 10:53:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f13a00f4-7853-4a71-88d2-5145a77d3338 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:53:57 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f13a00f4-7853-4a71-88d2-5145a77d3338 Nov 06 10:53:57 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:01 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:54:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Flow 'volume_create_manager' (0a339012-2f3a-44c2-beea-c0863234fefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:54:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b48a0b-15b7-4d96-8f76-28c4cf62b7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b48a0b-15b7-4d96-8f76-28c4cf62b7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2007335231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a665e68-fe33-48c1-97ab-dbfb9e9f9fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54cfcd14433048de8036453ce5d1f01b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=48e13bcf-fe03-4101-b7bf-b7ddb1960ab4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:54:02Z,use_quota=True,user_id='22d127b324234bc2affa0ca142bd5dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02bf7798-9631-4ee4-92af-7f2812ec2435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02bf7798-9631-4ee4-92af-7f2812ec2435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fe4549-8ba4-49a3-bbf5-22d26d208619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fe4549-8ba4-49a3-bbf5-22d26d208619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7a665e68-fe33-48c1-97ab-dbfb9e9f9fab', 'volume_name': 'volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab', 'volume_size': 1, 'snapshot_id': '48e13bcf-fe03-4101-b7bf-b7ddb1960ab4'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fcafab-cc08-48ad-a920-4e9551fdb7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fcafab-cc08-48ad-a920-4e9551fdb7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f08838-c92d-4119-86ca-b7d70a05d3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:01 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Volume 7a665e68-fe33-48c1-97ab-dbfb9e9f9fab: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab', 'volume_size': 1, 'snapshot_id': '48e13bcf-fe03-4101-b7bf-b7ddb1960ab4'} Nov 06 10:54:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:54:04 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f13a00f4-7853-4a71-88d2-5145a77d3338" returned: 0 in 7.392s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Image conversion details: src /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f13a00f4-7853-4a71-88d2-5145a77d3338 {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:54:04 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Converted 1024.00 MB image at 138.50 MB/s Nov 06 10:54:04 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f13a00f4-7853-4a71-88d2-5145a77d3338 is being set with open permissions: ugo+rw Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f13a00f4-7853-4a71-88d2-5145a77d3338 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:04 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f13a00f4-7853-4a71-88d2-5145a77d3338 Nov 06 10:54:04 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:04 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f13a00f4-7853-4a71-88d2-5145a77d3338" returned: 0 in 0.259s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-f13a00f4-7853-4a71-88d2-5145a77d3338" released by "_copy_volume_from_snapshot" :: held 8.544s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-4be328f2-b4cf-4211-86fa-0656387497ee-f13a00f4-7853-4a71-88d2-5145a77d3338" released by "_create_volume_from_snapshot" :: held 8.613s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.631s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.788s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Acquiring lock "cinder-quobyte-48e13bcf-fe03-4101-b7bf-b7ddb1960ab4-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab" by "_create_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Lock "cinder-quobyte-48e13bcf-fe03-4101-b7bf-b7ddb1960ab4-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Creating volume 7a665e68-fe33-48c1-97ab-dbfb9e9f9fab from snapshot 48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 {{(pid=86819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Acquiring lock "cinder-quobyte-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab" by "_copy_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f73dff-ffcb-4c0a-9142-fcbf4a07ad61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13a00f4-7853-4a71-88d2-5145a77d3338', 'volume_size': 1, 'snapshot_id': '4be328f2-b4cf-4211-86fa-0656387497ee'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1f9802-0b08-4ac6-8f46-66509eb6ea72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Lock "cinder-quobyte-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] snapshot: 48e13bcf-fe03-4101-b7bf-b7ddb1960ab4, volume: 7a665e68-fe33-48c1-97ab-dbfb9e9f9fab, {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 10:54:04 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Volume volume-f13a00f4-7853-4a71-88d2-5145a77d3338 (f13a00f4-7853-4a71-88d2-5145a77d3338): created successfully Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1f9802-0b08-4ac6-8f46-66509eb6ea72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Flow 'volume_create_manager' (5bf4de5a-120a-412d-bdcb-b522e23f02f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:54:04 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7674a49d-0446-4250-9994-c2ac43b2ae13 tempest-VolumesSnapshotTestJSON-1594272062 None] Created volume successfully. Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b149cdd-50dc-425a-90f2-93f3fbe127dd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:54:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:05 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 Nov 06 10:54:05 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:05 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4" returned: 0 in 0.394s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-903ad1b5-f228-4466-9ddd-214c647e0e7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:54:05 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[39142b56-e106-4c65-b955-00a4eccbabf0]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:54:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:05 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e Nov 06 10:54:05 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:05 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e" returned: 0 in 0.493s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] will copy from snapshot at /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 10:54:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Creating direct copy from snapshot {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 10:54:05 devstack cinder-volume[86819]: DEBUG cinder.utils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Path /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab not found in is_blk_device check {{(pid=86819) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 10:54:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:05 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab Nov 06 10:54:05 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-f13a00f4-7853-4a71-88d2-5145a77d3338-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-f13a00f4-7853-4a71-88d2-5145a77d3338-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-quobyte-f13a00f4-7853-4a71-88d2-5145a77d3338" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-f13a00f4-7853-4a71-88d2-5145a77d3338" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:06 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9bd9a1-1942-4cbe-8303-6bd47b1bc3bd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:54:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f13a00f4-7853-4a71-88d2-5145a77d3338 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:06 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f13a00f4-7853-4a71-88d2-5145a77d3338 Nov 06 10:54:06 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:06 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f13a00f4-7853-4a71-88d2-5145a77d3338" returned: 0 in 0.736s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f13a00f4-7853-4a71-88d2-5145a77d3338 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:06 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f13a00f4-7853-4a71-88d2-5145a77d3338 Nov 06 10:54:06 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:07 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f13a00f4-7853-4a71-88d2-5145a77d3338" returned: 0 in 0.594s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-f13a00f4-7853-4a71-88d2-5145a77d3338" released by "delete_volume" :: held 1.418s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:07 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Created reservations ['9da807ed-73b7-4b8e-9fd1-2233f39580cb', 'b1abd00a-aba4-4953-8d0c-d7ca39ccf697', '8ae20482-fdab-48e1-9d4f-e82bd73b97a9', 'f7abbbf1-5dfc-4f15-a8a1-ecccfb98f416'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:54:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:54:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:54:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:54:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:54:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:54:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:07 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:54:07 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:08 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.692s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:08 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:54:08 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Deleted volume successfully. Nov 06 10:54:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-25b9b9cc-71fa-48da-88e3-8159adb40441 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-f13a00f4-7853-4a71-88d2-5145a77d3338-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-4be328f2-b4cf-4211-86fa-0656387497ee-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-4be328f2-b4cf-4211-86fa-0656387497ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-quobyte-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-quobyte-4be328f2-b4cf-4211-86fa-0656387497ee" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-4be328f2-b4cf-4211-86fa-0656387497ee" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Deleting offline snapshot 4be328f2-b4cf-4211-86fa-0656387497ee of volume 6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:54:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] snapshot_file for this snap is: volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:54:08 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d99e86c-d970-4977-babe-595eb8b68866]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:54:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:08 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee Nov 06 10:54:08 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:09 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee" returned: 0 in 0.953s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:54:09 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6651bc-21d4-49a2-bf3e-0ca4acf93961]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:54:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:09 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 Nov 06 10:54:09 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:10 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1" returned: 0 in 1.116s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:10 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee Nov 06 10:54:10 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:11 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee" returned: 0 in 0.898s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:11 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee Nov 06 10:54:11 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:12 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1.4be328f2-b4cf-4211-86fa-0656387497ee" returned: 0 in 0.498s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-4be328f2-b4cf-4211-86fa-0656387497ee" released by "_delete_snapshot" :: held 3.725s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1" released by "delete_snapshot" :: held 3.765s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:12 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Created reservations ['fd843ce7-996f-4069-830f-b45d99fd9964', '44783305-31e7-465c-9736-9aeffbde0d34', '496d69fc-2b07-4ed8-afde-04a5de83a1e9', 'bfd8deef-ab7a-440b-bc9a-b75c97f897c8'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:54:12 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Delete snapshot completed successfully. Nov 06 10:54:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0343fbc1-b695-42f3-99d6-26f008fb6cb2 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-4be328f2-b4cf-4211-86fa-0656387497ee-delete_snapshot" released by "delete_snapshot" :: held 4.272s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:13 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:INSERT=22,cinder:UPDATE=94,cinder:SELECT=85,cinder:DELETE=8 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:54:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-quobyte-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1" acquired by "delete_volume" :: waited 0.053s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:13 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b93b2ec-df33-4dd9-a6f7-5863f16c5add]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:54:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:13 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 Nov 06 10:54:13 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:14 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1" returned: 0 in 0.821s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:14 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1 Nov 06 10:54:14 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:14 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1" returned: 0 in 0.476s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1" released by "delete_volume" :: held 1.512s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:15 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Created reservations ['3c3dbf07-b4d4-4e2f-8509-0e16e77d07cf', '41904b5b-54da-4b84-92eb-6c1920634af3', 'beea25ea-2267-4dd6-a2cd-bd5111fa9385', '838eb75b-8e56-4a56-974a-c781769885f2'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:54:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:54:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:54:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:54:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:54:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:54:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:15 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:54:15 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-233140e9-3219-4e76-9d37-4850b7c3cb66-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:16 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.878s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:16 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:54:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-233140e9-3219-4e76-9d37-4850b7c3cb66-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:16 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Deleted volume successfully. Nov 06 10:54:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-017f67cf-201c-4c1d-8a68-e0f8677948c0 tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-6977edbb-5bdb-413c-a0c0-c1a3d947f7c1-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "cinder-quobyte-233140e9-3219-4e76-9d37-4850b7c3cb66" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-233140e9-3219-4e76-9d37-4850b7c3cb66" acquired by "delete_volume" :: waited 0.064s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:16 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58fc559-35ce-4832-915d-0d73a778fd60]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:54:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:16 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab" returned: 0 in 10.982s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:16 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Image conversion details: src /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e, size 1024.00 MB, duration 10.98 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:54:16 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Converted 1024.00 MB image at 93.23 MB/s Nov 06 10:54:16 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab is being set with open permissions: ugo+rw Nov 06 10:54:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:16 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66 Nov 06 10:54:16 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:16 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab Nov 06 10:54:16 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:17 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab" returned: 0 in 0.323s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Lock "cinder-quobyte-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab" released by "_copy_volume_from_snapshot" :: held 12.328s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:17 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Lock "cinder-quobyte-48e13bcf-fe03-4101-b7bf-b7ddb1960ab4-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab" released by "_create_volume_from_snapshot" :: held 12.446s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.470s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66" returned: 0 in 0.677s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f08838-c92d-4119-86ca-b7d70a05d3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab', 'volume_size': 1, 'snapshot_id': '48e13bcf-fe03-4101-b7bf-b7ddb1960ab4'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:17 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66 Nov 06 10:54:17 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa225c78-dfd9-480c-b819-1aa5ef66b278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:17 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Volume volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab (7a665e68-fe33-48c1-97ab-dbfb9e9f9fab): created successfully Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa225c78-dfd9-480c-b819-1aa5ef66b278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Flow 'volume_create_manager' (0a339012-2f3a-44c2-beea-c0863234fefc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:54:17 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-997680ae-4931-46df-a66e-c176dd1c3df5 tempest-TestStampPattern-2028267074 None] Created volume successfully. Nov 06 10:54:17 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-233140e9-3219-4e76-9d37-4850b7c3cb66" returned: 0 in 0.413s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-quobyte-233140e9-3219-4e76-9d37-4850b7c3cb66" released by "delete_volume" :: held 1.253s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Created reservations ['ba3935d0-e426-4a14-b41a-798d3e9c17a0', '150afa78-7867-4e98-85d7-10415d287e22', 'efb5e095-325c-4a72-8924-0214c3ff7cb1', 'ee35ae96-b6f3-4cb8-a5a9-2097eb4f3d93'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:54:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:17 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:54:17 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:18 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.263s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:18 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:54:18 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Deleted volume successfully. Nov 06 10:54:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-38943cc8-cbed-4f7b-bb4a-e2ed063f683e tempest-VolumesSnapshotTestJSON-1594272062 None] Lock "cinder-233140e9-3219-4e76-9d37-4850b7c3cb66-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:27 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=78,cinder:INSERT=17,cinder:UPDATE=78,cinder:DELETE=7 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:54:28 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=7,cinder:INSERT=5,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:54:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:54:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:54:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:54:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:54:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:54:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:54:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:36 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:54:36 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:36 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.254s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:54:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:54:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 29 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:54:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:54:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-1587dd2a-07fb-4b81-9d45-edce3c526c41 req-c20f7101-643a-46c9-8c89-92825a3ee9ba tempest-TestStampPattern-2028267074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:54:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-1587dd2a-07fb-4b81-9d45-edce3c526c41 req-c20f7101-643a-46c9-8c89-92825a3ee9ba tempest-TestStampPattern-2028267074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:54:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-1587dd2a-07fb-4b81-9d45-edce3c526c41 req-c20f7101-643a-46c9-8c89-92825a3ee9ba tempest-TestStampPattern-2028267074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:54:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-1587dd2a-07fb-4b81-9d45-edce3c526c41 req-c20f7101-643a-46c9-8c89-92825a3ee9ba tempest-TestStampPattern-2028267074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be46d50e-d4df-4d5a-b4ee-04bcdc735970', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:54:42 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-1587dd2a-07fb-4b81-9d45-edce3c526c41 req-c20f7101-643a-46c9-8c89-92825a3ee9ba tempest-TestStampPattern-2028267074 None] attachment_update completed successfully. Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Flow 'volume_create_manager' (15ae217c-384d-4ffe-9df2-7fb1496a41aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ee859d-4933-4783-8c85-5a3c0cbfe0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ee859d-4933-4783-8c85-5a3c0cbfe0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1247692507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9f2316-c91e-46d3-8d66-a58ed376fe2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888e05b1433345ca9cdebf4b63b2f2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:54:45Z,use_quota=True,user_id='e65c6c7895a6478ba6b6d4665112809a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda553c1-9f63-4a68-9c09-ee3a74be0ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda553c1-9f63-4a68-9c09-ee3a74be0ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0eb9685-c5d4-44dc-81b4-0aa0e1d13dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0eb9685-c5d4-44dc-81b4-0aa0e1d13dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9f2316-c91e-46d3-8d66-a58ed376fe2a', 'volume_name': 'volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5bc0bda-9002-4e49-82a5-183d3a74a880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5bc0bda-9002-4e49-82a5-183d3a74a880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb48642-b523-4bc9-b2d9-8c9d7c2d4dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:44 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Volume 7f9f2316-c91e-46d3-8d66-a58ed376fe2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a', 'volume_size': 1} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1247692507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9f2316-c91e-46d3-8d66-a58ed376fe2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888e05b1433345ca9cdebf4b63b2f2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:54:45Z,use_quota=True,user_id='e65c6c7895a6478ba6b6d4665112809a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Creating volume 7f9f2316-c91e-46d3-8d66-a58ed376fe2a {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:54:44 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:54:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:45 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a 1073741824 Nov 06 10:54:45 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Flow 'volume_create_manager' (384b6745-84d7-4a4c-a111-c08d38b907aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73b3496-6fb0-4755-80cd-4d8be2406c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73b3496-6fb0-4755-80cd-4d8be2406c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-310682294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888e05b1433345ca9cdebf4b63b2f2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:54:45Z,use_quota=True,user_id='e65c6c7895a6478ba6b6d4665112809a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb00401-1da9-4331-9594-9cc5bfe31aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb00401-1da9-4331-9594-9cc5bfe31aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600032d2-97d8-4f12-b1d4-264a9acb5a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600032d2-97d8-4f12-b1d4-264a9acb5a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f', 'volume_name': 'volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04bd128-65ef-48b0-b8fb-ceac78637e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04bd128-65ef-48b0-b8fb-ceac78637e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8d626c-7e41-4baa-bffc-d1401717572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:45 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Volume cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f', 'volume_size': 1} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:54:45 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a 1073741824" returned: 0 in 0.583s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:45 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a Nov 06 10:54:45 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:45 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a" returned: 0 in 0.304s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.592s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-310682294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888e05b1433345ca9cdebf4b63b2f2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:54:45Z,use_quota=True,user_id='e65c6c7895a6478ba6b6d4665112809a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Creating volume cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:54:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:54:46 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb48642-b523-4bc9-b2d9-8c9d7c2d4dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:46 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f 1073741824 Nov 06 10:54:46 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45849af-66b2-4a2d-8a9b-a47d8b3fd77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:46 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Volume volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a (7f9f2316-c91e-46d3-8d66-a58ed376fe2a): created successfully Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45849af-66b2-4a2d-8a9b-a47d8b3fd77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Flow 'volume_create_manager' (15ae217c-384d-4ffe-9df2-7fb1496a41aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:54:46 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-0373fb33-1542-4669-9cf5-1fecebd8b3b5 req-9ea1f5d7-88e7-4dec-a698-9674364caee4 tempest-TestStampPattern-2028267074 None] Terminate volume connection completed successfully. Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-0373fb33-1542-4669-9cf5-1fecebd8b3b5 req-9ea1f5d7-88e7-4dec-a698-9674364caee4 tempest-TestStampPattern-2028267074 None] Deleting attachment be46d50e-d4df-4d5a-b4ee-04bcdc735970. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:54:46 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-28099a8f-c9da-4626-8245-67858fcbf079 tempest-TestServerVolumeAttachmentScenario-837381505 None] Created volume successfully. Nov 06 10:54:46 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f 1073741824" returned: 0 in 0.497s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:46 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f Nov 06 10:54:46 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:46 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f" returned: 0 in 0.297s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8d626c-7e41-4baa-bffc-d1401717572c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e649d3-3d07-46e8-8b02-76b6b4f56cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:54:46 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Volume volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f (cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f): created successfully Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e649d3-3d07-46e8-8b02-76b6b4f56cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:54:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Flow 'volume_create_manager' (384b6745-84d7-4a4c-a111-c08d38b907aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:54:46 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c3f6ab3c-b68c-41f9-8290-50ead2564675 tempest-TestServerVolumeAttachmentScenario-837381505 None] Created volume successfully. Nov 06 10:54:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Acquiring lock "cinder-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Lock "cinder-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Acquiring lock "cinder-quobyte-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Lock "cinder-quobyte-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:50 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e5acb3-9571-41e0-b289-a9d8b8601cd2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:54:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:50 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab Nov 06 10:54:50 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:51 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab" returned: 0 in 0.427s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:51 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab Nov 06 10:54:51 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:51 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab" returned: 0 in 0.252s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Lock "cinder-quobyte-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab" released by "delete_volume" :: held 0.785s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Created reservations ['a6641492-a157-4ae1-9b5c-e6d1cd76b074', 'f445522e-6c9f-4d66-98bf-4832e558468f', 'd9b9bd5e-af38-4c4b-8b08-bb3ef0c8952f', 'b0fedd24-1f94-4f5e-80e9-81c60177ca8c'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:51 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:54:51 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:51 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.274s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:54:51 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Deleted volume successfully. Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-da15b450-3ad4-4cce-9bec-ec63a84af5b2 tempest-TestStampPattern-2028267074 None] Lock "cinder-7a665e68-fe33-48c1-97ab-dbfb9e9f9fab-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Acquiring lock "cinder-48e13bcf-fe03-4101-b7bf-b7ddb1960ab4-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Lock "cinder-48e13bcf-fe03-4101-b7bf-b7ddb1960ab4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Acquiring lock "cinder-quobyte-903ad1b5-f228-4466-9ddd-214c647e0e7e" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Lock "cinder-quobyte-903ad1b5-f228-4466-9ddd-214c647e0e7e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Acquiring lock "cinder-quobyte-48e13bcf-fe03-4101-b7bf-b7ddb1960ab4" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Lock "cinder-quobyte-48e13bcf-fe03-4101-b7bf-b7ddb1960ab4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Deleting offline snapshot 48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 of volume 903ad1b5-f228-4466-9ddd-214c647e0e7e {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:54:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] snapshot_file for this snap is: volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:54:52 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4669a9b0-28ba-419a-8b31-64214afb3d23]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:54:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:52 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 Nov 06 10:54:52 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:52 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4" returned: 0 in 0.503s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-903ad1b5-f228-4466-9ddd-214c647e0e7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:54:52 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6c4ea2-e82c-40b7-8b4f-6f2a2f39a8cb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:54:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:52 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e Nov 06 10:54:52 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:53 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e" returned: 0 in 0.849s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:53 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 Nov 06 10:54:53 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:53 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4" returned: 0 in 0.467s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:53 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4 Nov 06 10:54:53 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:54 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e.48e13bcf-fe03-4101-b7bf-b7ddb1960ab4" returned: 0 in 0.327s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Lock "cinder-quobyte-48e13bcf-fe03-4101-b7bf-b7ddb1960ab4" released by "_delete_snapshot" :: held 2.326s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Lock "cinder-quobyte-903ad1b5-f228-4466-9ddd-214c647e0e7e" released by "delete_snapshot" :: held 2.355s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:54 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Created reservations ['ed916670-52a6-4d28-b2c6-725cf73aba9f', '521ac9b0-ba53-4e4d-8b62-3317a966b7ed', 'fa900e52-23d3-4bc4-b94e-c50dc1b79df1', '71ecb5dc-28fa-4568-92a9-9752f9b44bc9'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:54:54 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Delete snapshot completed successfully. Nov 06 10:54:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-553650b8-99a6-48d3-a069-8fad73ad1836 tempest-TestStampPattern-2028267074 None] Lock "cinder-48e13bcf-fe03-4101-b7bf-b7ddb1960ab4-delete_snapshot" released by "delete_snapshot" :: held 2.523s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:54:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Acquiring lock "cinder-903ad1b5-f228-4466-9ddd-214c647e0e7e-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Lock "cinder-903ad1b5-f228-4466-9ddd-214c647e0e7e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Acquiring lock "cinder-quobyte-903ad1b5-f228-4466-9ddd-214c647e0e7e" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:54:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Lock "cinder-quobyte-903ad1b5-f228-4466-9ddd-214c647e0e7e" acquired by "delete_volume" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:54:59 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d47a3d5-9056-4948-a458-021077f4a6bf]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:54:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:59 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e Nov 06 10:54:59 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:54:59 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Nov 06 10:54:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e" returned: 0 in 0.360s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:54:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:54:59 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e Nov 06 10:54:59 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:00 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-903ad1b5-f228-4466-9ddd-214c647e0e7e" returned: 0 in 0.248s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Lock "cinder-quobyte-903ad1b5-f228-4466-9ddd-214c647e0e7e" released by "delete_volume" :: held 0.669s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:00 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Created reservations ['0bd1a8fc-1f10-4fbd-af1b-e379abd7a70d', '50c63c5a-9efd-4879-988b-a58b3a8df9ef', 'b15a6be5-7473-4591-8dd5-cd5039830cfa', '95f3bb14-c535-4418-ab8b-ecd2a78ad463'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:55:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:55:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:55:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:00 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:55:00 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:00 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.364s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:00 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:55:00 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Deleted volume successfully. Nov 06 10:55:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-dbefa2c0-920c-4be9-bee8-3f63d89b3fa4 tempest-TestStampPattern-2028267074 None] Lock "cinder-903ad1b5-f228-4466-9ddd-214c647e0e7e-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:10 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=29,cinder:UPDATE=20,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:55:10 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=25,cinder:UPDATE=38,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Flow 'volume_create_manager' (87e977a8-765f-4de2-8220-f177fe052d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70ecd4c-a0e6-4214-83b3-a4a81cf920b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70ecd4c-a0e6-4214-83b3-a4a81cf920b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1084099026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b9d731-0ec2-4ad2-8867-4660426432fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbc6257e6ea4319bd61abb3e8a5a94f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:55:12Z,use_quota=True,user_id='a31aa57896dc476897b2dbd80855ed92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff52c63-e873-46d2-9d99-5316ac7ec625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff52c63-e873-46d2-9d99-5316ac7ec625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68c1d6c-866f-4ccf-94cb-c2241202c22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68c1d6c-866f-4ccf-94cb-c2241202c22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00b9d731-0ec2-4ad2-8867-4660426432fb', 'volume_name': 'volume-00b9d731-0ec2-4ad2-8867-4660426432fb', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d662c5-717d-4075-a10d-94a8d09cf8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d662c5-717d-4075-a10d-94a8d09cf8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c315a82e-4c03-4cd1-8faf-26716cbc6b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:12 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Volume 00b9d731-0ec2-4ad2-8867-4660426432fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00b9d731-0ec2-4ad2-8867-4660426432fb', 'volume_size': 1} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1084099026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b9d731-0ec2-4ad2-8867-4660426432fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbc6257e6ea4319bd61abb3e8a5a94f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:55:12Z,use_quota=True,user_id='a31aa57896dc476897b2dbd80855ed92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Creating volume 00b9d731-0ec2-4ad2-8867-4660426432fb {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:55:12 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-00b9d731-0ec2-4ad2-8867-4660426432fb 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:12 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-00b9d731-0ec2-4ad2-8867-4660426432fb 1073741824 Nov 06 10:55:12 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Flow 'volume_create_manager' (3f764d5e-42f8-440f-bb7b-121c31ffdfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f01fd81-ee1b-49ac-a2a5-963f6970bc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f01fd81-ee1b-49ac-a2a5-963f6970bc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1500916275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c042bc2-fab7-40c4-a89f-f8a120a00221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbc6257e6ea4319bd61abb3e8a5a94f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:55:13Z,use_quota=True,user_id='a31aa57896dc476897b2dbd80855ed92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8345264-9a85-46a8-92f0-414707742120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8345264-9a85-46a8-92f0-414707742120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd001f72-5d09-418c-ba46-f706fc73c8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd001f72-5d09-418c-ba46-f706fc73c8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c042bc2-fab7-40c4-a89f-f8a120a00221', 'volume_name': 'volume-4c042bc2-fab7-40c4-a89f-f8a120a00221', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248a65f4-284d-42ab-9a34-a3389ff8491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248a65f4-284d-42ab-9a34-a3389ff8491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f2777e-663c-47ef-897b-c620c552484b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:12 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Volume 4c042bc2-fab7-40c4-a89f-f8a120a00221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c042bc2-fab7-40c4-a89f-f8a120a00221', 'volume_size': 1} Nov 06 10:55:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:13 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-00b9d731-0ec2-4ad2-8867-4660426432fb 1073741824" returned: 0 in 0.527s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-00b9d731-0ec2-4ad2-8867-4660426432fb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:13 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-00b9d731-0ec2-4ad2-8867-4660426432fb Nov 06 10:55:13 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Flow 'volume_create_manager' (290c562a-17ca-4b99-a96d-c14fb60b22d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ea66d1-16ee-4651-abd7-621cbf28fb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ea66d1-16ee-4651-abd7-621cbf28fb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1810351200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22387b0-3edb-4a79-a325-5af44e962acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbc6257e6ea4319bd61abb3e8a5a94f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:55:13Z,use_quota=True,user_id='a31aa57896dc476897b2dbd80855ed92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03a898e-98c3-443a-981d-9702ffeedf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03a898e-98c3-443a-981d-9702ffeedf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cb3702-40cb-4db0-b0bc-5a00b94986d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cb3702-40cb-4db0-b0bc-5a00b94986d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f22387b0-3edb-4a79-a325-5af44e962acc', 'volume_name': 'volume-f22387b0-3edb-4a79-a325-5af44e962acc', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7430984a-6d7e-489f-80c8-10b6079beef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7430984a-6d7e-489f-80c8-10b6079beef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1565fe-cc8e-4c4e-b0fb-6eba6d0f59af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:13 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Volume f22387b0-3edb-4a79-a325-5af44e962acc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f22387b0-3edb-4a79-a325-5af44e962acc', 'volume_size': 1} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:13 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-00b9d731-0ec2-4ad2-8867-4660426432fb" returned: 0 in 0.282s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.467s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1500916275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c042bc2-fab7-40c4-a89f-f8a120a00221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbc6257e6ea4319bd61abb3e8a5a94f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:55:13Z,use_quota=True,user_id='a31aa57896dc476897b2dbd80855ed92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Creating volume 4c042bc2-fab7-40c4-a89f-f8a120a00221 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:55:13 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4c042bc2-fab7-40c4-a89f-f8a120a00221 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c315a82e-4c03-4cd1-8faf-26716cbc6b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00b9d731-0ec2-4ad2-8867-4660426432fb', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52afac8-8858-4453-84fa-c74870ed540d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:13 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4c042bc2-fab7-40c4-a89f-f8a120a00221 1073741824 Nov 06 10:55:13 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:13 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Volume volume-00b9d731-0ec2-4ad2-8867-4660426432fb (00b9d731-0ec2-4ad2-8867-4660426432fb): created successfully Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52afac8-8858-4453-84fa-c74870ed540d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Flow 'volume_create_manager' (87e977a8-765f-4de2-8220-f177fe052d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:55:13 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-1ddd4960-ebe4-437e-a64a-09b5ad440dc2 tempest-CreateVolumesFromImageTest-78224915 None] Created volume successfully. Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Flow 'volume_create_manager' (c40fea03-6ffc-480a-9f95-cf16372dd729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eff6516-8524-45fe-a370-d4bcdf4ae3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eff6516-8524-45fe-a370-d4bcdf4ae3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1056998463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ffef1b2-b206-4d67-93b3-bee6f46f78b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbc6257e6ea4319bd61abb3e8a5a94f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:55:14Z,use_quota=True,user_id='a31aa57896dc476897b2dbd80855ed92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6974e7f0-626f-49d8-a5c5-20824acd381f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6974e7f0-626f-49d8-a5c5-20824acd381f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1869d8a4-4c2e-4b5e-b4d9-ce742626419d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1869d8a4-4c2e-4b5e-b4d9-ce742626419d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ffef1b2-b206-4d67-93b3-bee6f46f78b0', 'volume_name': 'volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba38855-8e1e-4ec0-b8aa-66b0ad563c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba38855-8e1e-4ec0-b8aa-66b0ad563c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e998992c-40df-4586-ae12-c71d60384608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:13 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Volume 4ffef1b2-b206-4d67-93b3-bee6f46f78b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0', 'volume_size': 1} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Flow 'volume_create_manager' (94bde8a2-6149-4273-8b2d-9529f4810a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2c8d63-f478-42e3-9493-5ebe48efc72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:13 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4c042bc2-fab7-40c4-a89f-f8a120a00221 1073741824" returned: 0 in 0.582s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2c8d63-f478-42e3-9493-5ebe48efc72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-978284519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ece6c80-097d-4048-a415-e8a69a6c5dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbc6257e6ea4319bd61abb3e8a5a94f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:55:14Z,use_quota=True,user_id='a31aa57896dc476897b2dbd80855ed92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ea46a3-8455-401c-899c-a7705b6071f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ea46a3-8455-401c-899c-a7705b6071f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7535fe7d-1ca1-4f39-a4e7-78e8055f8a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7535fe7d-1ca1-4f39-a4e7-78e8055f8a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ece6c80-097d-4048-a415-e8a69a6c5dee', 'volume_name': 'volume-1ece6c80-097d-4048-a415-e8a69a6c5dee', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a578459c-9bb4-4692-93bf-3d067df9fb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a578459c-9bb4-4692-93bf-3d067df9fb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec17dbb6-b787-43f3-a595-5fbb0c549047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:14 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Volume 1ece6c80-097d-4048-a415-e8a69a6c5dee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ece6c80-097d-4048-a415-e8a69a6c5dee', 'volume_size': 1} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4c042bc2-fab7-40c4-a89f-f8a120a00221 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:14 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4c042bc2-fab7-40c4-a89f-f8a120a00221 Nov 06 10:55:14 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:14 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4c042bc2-fab7-40c4-a89f-f8a120a00221" returned: 0 in 0.261s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.055s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1810351200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22387b0-3edb-4a79-a325-5af44e962acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbc6257e6ea4319bd61abb3e8a5a94f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:55:13Z,use_quota=True,user_id='a31aa57896dc476897b2dbd80855ed92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Creating volume f22387b0-3edb-4a79-a325-5af44e962acc {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:55:14 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f22387b0-3edb-4a79-a325-5af44e962acc 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f2777e-663c-47ef-897b-c620c552484b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c042bc2-fab7-40c4-a89f-f8a120a00221', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:14 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f22387b0-3edb-4a79-a325-5af44e962acc 1073741824 Nov 06 10:55:14 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36888328-7b2c-4165-a19a-3fbbf2d013dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:14 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Volume volume-4c042bc2-fab7-40c4-a89f-f8a120a00221 (4c042bc2-fab7-40c4-a89f-f8a120a00221): created successfully Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36888328-7b2c-4165-a19a-3fbbf2d013dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Flow 'volume_create_manager' (3f764d5e-42f8-440f-bb7b-121c31ffdfa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:55:14 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-1c937f47-18a1-45a5-83dc-6002c6f91063 tempest-CreateVolumesFromImageTest-78224915 None] Created volume successfully. Nov 06 10:55:14 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f22387b0-3edb-4a79-a325-5af44e962acc 1073741824" returned: 0 in 0.442s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f22387b0-3edb-4a79-a325-5af44e962acc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:14 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f22387b0-3edb-4a79-a325-5af44e962acc Nov 06 10:55:14 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:15 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f22387b0-3edb-4a79-a325-5af44e962acc" returned: 0 in 0.246s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.350s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1056998463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ffef1b2-b206-4d67-93b3-bee6f46f78b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbc6257e6ea4319bd61abb3e8a5a94f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:55:14Z,use_quota=True,user_id='a31aa57896dc476897b2dbd80855ed92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Creating volume 4ffef1b2-b206-4d67-93b3-bee6f46f78b0 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:55:15 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1565fe-cc8e-4c4e-b0fb-6eba6d0f59af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f22387b0-3edb-4a79-a325-5af44e962acc', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f925f6-f9dc-4898-a0c1-0a593924eda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:15 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0 1073741824 Nov 06 10:55:15 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:15 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Volume volume-f22387b0-3edb-4a79-a325-5af44e962acc (f22387b0-3edb-4a79-a325-5af44e962acc): created successfully Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f925f6-f9dc-4898-a0c1-0a593924eda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Flow 'volume_create_manager' (290c562a-17ca-4b99-a96d-c14fb60b22d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:55:15 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-519ba8bd-3eba-434b-b966-40edbc95a577 tempest-CreateVolumesFromImageTest-78224915 None] Created volume successfully. Nov 06 10:55:15 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0 1073741824" returned: 0 in 0.448s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:15 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0 Nov 06 10:55:15 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:15 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0" returned: 0 in 0.251s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.773s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-978284519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ece6c80-097d-4048-a415-e8a69a6c5dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbc6257e6ea4319bd61abb3e8a5a94f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:55:14Z,use_quota=True,user_id='a31aa57896dc476897b2dbd80855ed92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Creating volume 1ece6c80-097d-4048-a415-e8a69a6c5dee {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:55:15 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1ece6c80-097d-4048-a415-e8a69a6c5dee 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e998992c-40df-4586-ae12-c71d60384608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e422c3-f331-496c-9850-ad4a457460a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:15 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1ece6c80-097d-4048-a415-e8a69a6c5dee 1073741824 Nov 06 10:55:15 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:15 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Volume volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0 (4ffef1b2-b206-4d67-93b3-bee6f46f78b0): created successfully Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e422c3-f331-496c-9850-ad4a457460a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Flow 'volume_create_manager' (c40fea03-6ffc-480a-9f95-cf16372dd729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:55:15 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-0b13a731-2e36-4f76-8ef2-4e7b2fb40bd6 tempest-CreateVolumesFromImageTest-78224915 None] Created volume successfully. Nov 06 10:55:16 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1ece6c80-097d-4048-a415-e8a69a6c5dee 1073741824" returned: 0 in 0.473s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1ece6c80-097d-4048-a415-e8a69a6c5dee {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:16 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1ece6c80-097d-4048-a415-e8a69a6c5dee Nov 06 10:55:16 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:16 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1ece6c80-097d-4048-a415-e8a69a6c5dee" returned: 0 in 0.274s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:55:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec17dbb6-b787-43f3-a595-5fbb0c549047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ece6c80-097d-4048-a415-e8a69a6c5dee', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8b49a9-a757-40f8-812e-0857f3792925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:55:16 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Volume volume-1ece6c80-097d-4048-a415-e8a69a6c5dee (1ece6c80-097d-4048-a415-e8a69a6c5dee): created successfully Nov 06 10:55:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8b49a9-a757-40f8-812e-0857f3792925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:55:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Flow 'volume_create_manager' (94bde8a2-6149-4273-8b2d-9529f4810a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:55:16 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a6594ba3-1c8c-4985-a377-a696209ddad4 tempest-CreateVolumesFromImageTest-78224915 None] Created volume successfully. Nov 06 10:55:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "cinder-1ece6c80-097d-4048-a415-e8a69a6c5dee-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:55:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-1ece6c80-097d-4048-a415-e8a69a6c5dee-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:55:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "cinder-quobyte-1ece6c80-097d-4048-a415-e8a69a6c5dee" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:55:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-quobyte-1ece6c80-097d-4048-a415-e8a69a6c5dee" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:55:17 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[900585db-6831-4434-a620-c2dfa810cc96]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:55:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1ece6c80-097d-4048-a415-e8a69a6c5dee {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:17 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1ece6c80-097d-4048-a415-e8a69a6c5dee Nov 06 10:55:17 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:17 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1ece6c80-097d-4048-a415-e8a69a6c5dee" returned: 0 in 0.442s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1ece6c80-097d-4048-a415-e8a69a6c5dee {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:17 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1ece6c80-097d-4048-a415-e8a69a6c5dee Nov 06 10:55:17 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-05ebc036-7dde-4de5-86ff-c1601a2dcfc2 req-932d125a-90dc-4151-90ab-dddc66e0ba66 tempest-TestServerVolumeAttachmentScenario-837381505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-05ebc036-7dde-4de5-86ff-c1601a2dcfc2 req-932d125a-90dc-4151-90ab-dddc66e0ba66 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-05ebc036-7dde-4de5-86ff-c1601a2dcfc2 req-932d125a-90dc-4151-90ab-dddc66e0ba66 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-05ebc036-7dde-4de5-86ff-c1601a2dcfc2 req-932d125a-90dc-4151-90ab-dddc66e0ba66 tempest-TestServerVolumeAttachmentScenario-837381505 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '405d8803-2aa3-4755-976e-7edca1b76dc7', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:55:18 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-05ebc036-7dde-4de5-86ff-c1601a2dcfc2 req-932d125a-90dc-4151-90ab-dddc66e0ba66 tempest-TestServerVolumeAttachmentScenario-837381505 None] attachment_update completed successfully. Nov 06 10:55:18 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1ece6c80-097d-4048-a415-e8a69a6c5dee" returned: 0 in 0.282s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-quobyte-1ece6c80-097d-4048-a415-e8a69a6c5dee" released by "delete_volume" :: held 0.777s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Created reservations ['bad93fd8-7fce-422a-9258-446d6fbebdc6', '5e041a9e-ef37-484e-8eea-f0086cab320e', '5fe4c548-a29c-419a-8fba-b949b186e3be', '3c0b37f7-586c-4b56-b077-727764319447'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:18 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:55:18 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "cinder-4ffef1b2-b206-4d67-93b3-bee6f46f78b0-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-4ffef1b2-b206-4d67-93b3-bee6f46f78b0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "cinder-quobyte-4ffef1b2-b206-4d67-93b3-bee6f46f78b0" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:55:18 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.298s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-quobyte-4ffef1b2-b206-4d67-93b3-bee6f46f78b0" acquired by "delete_volume" :: waited 0.025s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:55:18 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Deleted volume successfully. Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1d500f-2bcb-4e9e-9c81-bd3601f082fd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b5f52379-022d-42fa-a8aa-b760c672a1cf tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-1ece6c80-097d-4048-a415-e8a69a6c5dee-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:18 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0 Nov 06 10:55:18 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:19 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0" returned: 0 in 0.379s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:19 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0 Nov 06 10:55:19 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:19 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4ffef1b2-b206-4d67-93b3-bee6f46f78b0" returned: 0 in 0.251s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-quobyte-4ffef1b2-b206-4d67-93b3-bee6f46f78b0" released by "delete_volume" :: held 0.688s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Created reservations ['5ccddc13-4936-4c82-8039-ea582d46bd33', '79013f64-b7dd-4b0b-bdc8-5b07e6f0b2ac', '173b257f-6511-4444-a777-49a52ee7f31d', 'ce924e42-a05e-440f-aff5-4cc6e7ca8255'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:19 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:55:19 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:19 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.250s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "cinder-f22387b0-3edb-4a79-a325-5af44e962acc-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:55:19 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Deleted volume successfully. Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-f22387b0-3edb-4a79-a325-5af44e962acc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-92c6c517-2ffd-485b-86fa-a031eb5b9c6e tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-4ffef1b2-b206-4d67-93b3-bee6f46f78b0-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "cinder-quobyte-f22387b0-3edb-4a79-a325-5af44e962acc" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-quobyte-f22387b0-3edb-4a79-a325-5af44e962acc" acquired by "delete_volume" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74a5689-33f9-4696-b726-6e1bc84c7486]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:55:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f22387b0-3edb-4a79-a325-5af44e962acc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:19 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f22387b0-3edb-4a79-a325-5af44e962acc Nov 06 10:55:19 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:20 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f22387b0-3edb-4a79-a325-5af44e962acc" returned: 0 in 0.370s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f22387b0-3edb-4a79-a325-5af44e962acc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:20 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f22387b0-3edb-4a79-a325-5af44e962acc Nov 06 10:55:20 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:20 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f22387b0-3edb-4a79-a325-5af44e962acc" returned: 0 in 0.254s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-quobyte-f22387b0-3edb-4a79-a325-5af44e962acc" released by "delete_volume" :: held 0.664s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Created reservations ['cd7262ca-d568-4c98-8d0a-0d0858464e6c', 'c40e26b7-73ae-4eee-9453-4ddcf799f500', '511154bd-6d25-4db9-9a95-4dae9c383858', '0d5258e5-0e6c-4362-a73f-b87fe3c4baeb'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:20 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:55:20 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:20 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.253s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:55:20 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Deleted volume successfully. Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-54716886-1a00-4a8c-83f6-d3c3e85cc264 tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-f22387b0-3edb-4a79-a325-5af44e962acc-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "cinder-4c042bc2-fab7-40c4-a89f-f8a120a00221-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:55:20 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-4c042bc2-fab7-40c4-a89f-f8a120a00221-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:55:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "cinder-quobyte-4c042bc2-fab7-40c4-a89f-f8a120a00221" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:55:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-quobyte-4c042bc2-fab7-40c4-a89f-f8a120a00221" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:55:21 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f076301-5bc1-4dbd-9914-3dbf22b7081c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:55:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4c042bc2-fab7-40c4-a89f-f8a120a00221 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:21 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4c042bc2-fab7-40c4-a89f-f8a120a00221 Nov 06 10:55:21 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:21 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4c042bc2-fab7-40c4-a89f-f8a120a00221" returned: 0 in 0.389s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4c042bc2-fab7-40c4-a89f-f8a120a00221 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:21 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4c042bc2-fab7-40c4-a89f-f8a120a00221 Nov 06 10:55:21 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:21 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4c042bc2-fab7-40c4-a89f-f8a120a00221" returned: 0 in 0.251s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-quobyte-4c042bc2-fab7-40c4-a89f-f8a120a00221" released by "delete_volume" :: held 0.682s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:21 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Created reservations ['e6006009-6064-4c78-a2b8-17486940d674', '3231c6d6-0001-4138-9f96-200fd2d45042', 'f76f5599-4e9a-4fee-821b-31c33b377771', '69b2ef14-643d-4a0e-8588-32768a784b97'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:55:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:55:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:55:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:21 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:55:21 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:22 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.251s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:55:22 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Deleted volume successfully. Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d5b45a66-1080-4fa8-9175-43fb3bc83afe tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-4c042bc2-fab7-40c4-a89f-f8a120a00221-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "cinder-00b9d731-0ec2-4ad2-8867-4660426432fb-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-00b9d731-0ec2-4ad2-8867-4660426432fb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "cinder-quobyte-00b9d731-0ec2-4ad2-8867-4660426432fb" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-quobyte-00b9d731-0ec2-4ad2-8867-4660426432fb" acquired by "delete_volume" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f624f7-3024-4cb5-81e4-08389a6d827a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-00b9d731-0ec2-4ad2-8867-4660426432fb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:22 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-00b9d731-0ec2-4ad2-8867-4660426432fb Nov 06 10:55:22 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:22 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-00b9d731-0ec2-4ad2-8867-4660426432fb" returned: 0 in 0.400s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-00b9d731-0ec2-4ad2-8867-4660426432fb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:22 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-00b9d731-0ec2-4ad2-8867-4660426432fb Nov 06 10:55:22 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-f11e5083-2f32-401e-a374-80b8de4eb51b req-b9540fad-036c-48d9-9804-0428d31a2f2b tempest-TestServerVolumeAttachmentScenario-837381505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-f11e5083-2f32-401e-a374-80b8de4eb51b req-b9540fad-036c-48d9-9804-0428d31a2f2b tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-f11e5083-2f32-401e-a374-80b8de4eb51b req-b9540fad-036c-48d9-9804-0428d31a2f2b tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-f11e5083-2f32-401e-a374-80b8de4eb51b req-b9540fad-036c-48d9-9804-0428d31a2f2b tempest-TestServerVolumeAttachmentScenario-837381505 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bdd578a-e2f1-4e53-9767-086067be23a8', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:55:22 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-f11e5083-2f32-401e-a374-80b8de4eb51b req-b9540fad-036c-48d9-9804-0428d31a2f2b tempest-TestServerVolumeAttachmentScenario-837381505 None] attachment_update completed successfully. Nov 06 10:55:22 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-00b9d731-0ec2-4ad2-8867-4660426432fb" returned: 0 in 0.271s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-quobyte-00b9d731-0ec2-4ad2-8867-4660426432fb" released by "delete_volume" :: held 0.720s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:22 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Created reservations ['eca7eb38-6581-48a7-9657-9a58b4a3bfb7', '02fec33d-9ee1-418f-b4da-05ade22db1fc', '71e00e8d-db65-4149-8b71-6dcb9c66237a', 'abe71c96-d65f-40e5-b78d-0982109e34ee'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:55:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:55:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:55:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:23 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:55:23 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:23 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.283s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:23 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:55:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Deleted volume successfully. Nov 06 10:55:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e4b32d7c-4f50-43ce-84ad-29b98bc439d6 tempest-CreateVolumesFromImageTest-78224915 None] Lock "cinder-00b9d731-0ec2-4ad2-8867-4660426432fb-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:24 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-03256c5a-0375-4cb8-890b-5c4e0e0b6dba req-a07a45aa-cb56-4c38-a051-330f899bdd90 tempest-TestServerVolumeAttachmentScenario-837381505 None] Terminate volume connection completed successfully. Nov 06 10:55:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-03256c5a-0375-4cb8-890b-5c4e0e0b6dba req-a07a45aa-cb56-4c38-a051-330f899bdd90 tempest-TestServerVolumeAttachmentScenario-837381505 None] Deleting attachment 5bdd578a-e2f1-4e53-9767-086067be23a8. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:55:25 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-f116ac1d-4677-4bb6-a079-0dd2d89c3e1c req-b73afbe5-fb72-425c-8df8-7f915f6bd17b tempest-TestServerVolumeAttachmentScenario-837381505 None] Terminate volume connection completed successfully. Nov 06 10:55:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-f116ac1d-4677-4bb6-a079-0dd2d89c3e1c req-b73afbe5-fb72-425c-8df8-7f915f6bd17b tempest-TestServerVolumeAttachmentScenario-837381505 None] Deleting attachment 405d8803-2aa3-4755-976e-7edca1b76dc7. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Acquiring lock "cinder-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "cinder-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Acquiring lock "cinder-quobyte-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "cinder-quobyte-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f" acquired by "delete_volume" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea5325f-a5df-43f4-9c54-8145f81370dd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:31 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f Nov 06 10:55:31 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:31 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f" returned: 0 in 0.350s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:31 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f Nov 06 10:55:31 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:31 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f" returned: 0 in 0.240s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "cinder-quobyte-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f" released by "delete_volume" :: held 0.629s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Created reservations ['8b1a5073-b5a6-4219-9e07-898da910760c', '4c9f184b-62f2-4826-8891-a5ac3e32ef20', 'a555c1ce-31a9-4747-ae30-22a3ad1f7a20', 'a703cd4c-b345-4772-a66a-4cc56c59ba20'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:32 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:55:32 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:32 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.237s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:32 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:55:32 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Deleted volume successfully. Nov 06 10:55:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-37579a0e-b9f5-478a-8803-84352fbcdbd4 tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "cinder-cb9fc35b-7a4c-4f0c-a489-bbe5b4bd2a5f-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Acquiring lock "cinder-7f9f2316-c91e-46d3-8d66-a58ed376fe2a-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:55:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "cinder-7f9f2316-c91e-46d3-8d66-a58ed376fe2a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:55:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Acquiring lock "cinder-quobyte-7f9f2316-c91e-46d3-8d66-a58ed376fe2a" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:55:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "cinder-quobyte-7f9f2316-c91e-46d3-8d66-a58ed376fe2a" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:55:32 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c5baf3-bb7c-4a65-9dac-36aef2b197db]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:55:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:32 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a Nov 06 10:55:32 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:32 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a" returned: 0 in 0.347s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:32 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a Nov 06 10:55:32 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:33 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7f9f2316-c91e-46d3-8d66-a58ed376fe2a" returned: 0 in 0.243s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "cinder-quobyte-7f9f2316-c91e-46d3-8d66-a58ed376fe2a" released by "delete_volume" :: held 0.632s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:33 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Created reservations ['baa08dbf-0166-49f5-a03a-733e6c86d818', '3880492e-e678-4373-8a2b-6f14e66ff281', '1a5a2ef6-c3a1-4cae-8068-ca599dd3774d', 'e09e7e16-7a3a-4ae3-9fb5-06d47f2f0f5d'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:55:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:55:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:55:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:33 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:55:33 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:33 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.238s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:33 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:55:33 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Deleted volume successfully. Nov 06 10:55:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-aac71763-a71f-42dc-b92f-ae7535f2046a tempest-TestServerVolumeAttachmentScenario-837381505 None] Lock "cinder-7f9f2316-c91e-46d3-8d66-a58ed376fe2a-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:55:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:55:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:55:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:55:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:55:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:55:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:55:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:55:36 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:55:36 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:55:36 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Nov 06 10:55:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.236s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:55:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:55:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:55:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 29 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:55:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:55:43 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=75,cinder:SELECT=53,cinder:DELETE=6,cinder:INSERT=16 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:55:43 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=67,cinder:UPDATE=73,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Flow 'volume_create_manager' (b0001f42-375d-4e96-8fac-85e8a2bdd0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95f168b-94c7-4051-8ee1-219c0f460b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95f168b-94c7-4051-8ee1-219c0f460b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-931312269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0806c1-8c06-4c12-b0d7-1af053a302df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5230867b002e4244876c393d6d4efff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:56:04Z,use_quota=True,user_id='d08f9021335142d48ba4e9b35fcdcfdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f191b2a-6cf9-425b-9dfa-f8efce37342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f191b2a-6cf9-425b-9dfa-f8efce37342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ebf9e7-9bfd-4655-9381-80556e1e7672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG cinder.image.glance [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Creating Keystone auth plugin from conf {{(pid=86819) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ebf9e7-9bfd-4655-9381-80556e1e7672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ab0806c1-8c06-4c12-b0d7-1af053a302df', 'volume_name': 'volume-ab0806c1-8c06-4c12-b0d7-1af053a302df', 'volume_size': 1, 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a31bb778f245ada373212e6fd01b04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'created_at': datetime.datetime(2026, 11, 6, 9, 33, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3141da4f-e70d-439b-81af-e22387bd01d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97de8f2d-78c2-4ee8-8d7a-42b7b8691126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97de8f2d-78c2-4ee8-8d7a-42b7b8691126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ac0614-78ac-4e79-9218-83a156c579be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:56:04 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Volume ab0806c1-8c06-4c12-b0d7-1af053a302df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ab0806c1-8c06-4c12-b0d7-1af053a302df', 'volume_size': 1, 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a31bb778f245ada373212e6fd01b04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'created_at': datetime.datetime(2026, 11, 6, 9, 33, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3141da4f-e70d-439b-81af-e22387bd01d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Trying to clone ab0806c1-8c06-4c12-b0d7-1af053a302df from image 3141da4f-e70d-439b-81af-e22387bd01d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]). {{(pid=86819) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_2d8wtag8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 10:56:04 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Image download 20.69 MB at 20.69 MB/s Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec1c3a5-fae6-40d4-94f3-36d6741a6edc]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:56:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_2d8wtag8devstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:56:04 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_2d8wtag8devstack@QuobyteHD Nov 06 10:56:04 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:56:05 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_2d8wtag8devstack@QuobyteHD" returned: 0 in 0.331s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Temporary image 3141da4f-e70d-439b-81af-e22387bd01d4 is fetched for user d08f9021335142d48ba4e9b35fcdcfdb. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54250b9-c248-4b8a-8988-02b806fdac54]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_2d8wtag8devstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:56:05 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_2d8wtag8devstack@QuobyteHD Nov 06 10:56:05 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:56:05 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_2d8wtag8devstack@QuobyteHD" returned: 0 in 0.329s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-931312269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0806c1-8c06-4c12-b0d7-1af053a302df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5230867b002e4244876c393d6d4efff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:56:04Z,use_quota=True,user_id='d08f9021335142d48ba4e9b35fcdcfdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Creating volume ab0806c1-8c06-4c12-b0d7-1af053a302df {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:56:05 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:56:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:56:05 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df 1073741824 Nov 06 10:56:05 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:56:06 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Nov 06 10:56:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df 1073741824" returned: 0 in 0.410s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:56:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:56:06 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df Nov 06 10:56:06 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:56:06 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Nov 06 10:56:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df" returned: 0 in 0.266s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:56:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:56:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:56:06 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Attempting download of 3141da4f-e70d-439b-81af-e22387bd01d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}])) to volume ab0806c1-8c06-4c12-b0d7-1af053a302df. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 10:56:06 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a2e990-772c-4096-8df6-107184de3b1b]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:56:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_cor4knyr {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:56:06 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_cor4knyr Nov 06 10:56:06 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:56:06 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Nov 06 10:56:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_cor4knyr" returned: 0 in 0.322s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:56:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_cor4knyr {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:56:06 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_cor4knyr Nov 06 10:56:06 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:56:07 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Nov 06 10:56:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_cor4knyr" returned: 1 in 0.334s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:56:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3141da4f-e70d-439b-81af-e22387bd01d4_cor4knyr' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:56:07 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9ff65e-d30d-4e4f-a809-17ffc503bdd7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:56:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_2d8wtag8devstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:56:07 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_2d8wtag8devstack@QuobyteHD Nov 06 10:56:07 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:56:07 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Nov 06 10:56:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_2d8wtag8devstack@QuobyteHD" returned: 0 in 0.329s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:56:07 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] 3141da4f-e70d-439b-81af-e22387bd01d4 was qcow2, converting to qcow2 {{(pid=86819) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 10:56:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_2d8wtag8devstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:56:07 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_2d8wtag8devstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df Nov 06 10:56:07 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:56:09 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Nov 06 10:56:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_2d8wtag8devstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df" returned: 0 in 1.778s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:56:09 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3141da4f-e70d-439b-81af-e22387bd01d4_2d8wtag8devstack@QuobyteHD, size 112.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:56:09 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Converted 112.00 MB image at 62.95 MB/s Nov 06 10:56:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:56:09 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df 1G Nov 06 10:56:09 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:56:09 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Nov 06 10:56:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df 1G" returned: 0 in 0.310s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:56:09 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Downloaded image 3141da4f-e70d-439b-81af-e22387bd01d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}])) to volume ab0806c1-8c06-4c12-b0d7-1af053a302df successfully. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 10:56:09 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Temporary image 3141da4f-e70d-439b-81af-e22387bd01d4 for user d08f9021335142d48ba4e9b35fcdcfdb is deleted. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 10:56:09 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Marking volume ab0806c1-8c06-4c12-b0d7-1af053a302df as bootable. {{(pid=86819) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 10:56:09 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Copying metadata from image 3141da4f-e70d-439b-81af-e22387bd01d4 to ab0806c1-8c06-4c12-b0d7-1af053a302df. {{(pid=86819) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 10:56:09 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Creating volume glance metadata for volume ab0806c1-8c06-4c12-b0d7-1af053a302df backed by image 3141da4f-e70d-439b-81af-e22387bd01d4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86819) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 10:56:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ac0614-78ac-4e79-9218-83a156c579be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab0806c1-8c06-4c12-b0d7-1af053a302df', 'volume_size': 1, 'image_id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3141da4f-e70d-439b-81af-e22387bd01d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a31bb778f245ada373212e6fd01b04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3141da4f-e70d-439b-81af-e22387bd01d4', 'created_at': datetime.datetime(2026, 11, 6, 9, 33, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 33, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3141da4f-e70d-439b-81af-e22387bd01d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:56:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34163af-2c73-4368-9f15-821e9b67efa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:56:09 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Volume volume-ab0806c1-8c06-4c12-b0d7-1af053a302df (ab0806c1-8c06-4c12-b0d7-1af053a302df): created successfully Nov 06 10:56:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34163af-2c73-4368-9f15-821e9b67efa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:56:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Flow 'volume_create_manager' (b0001f42-375d-4e96-8fac-85e8a2bdd0e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:56:09 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-4b13f647-80f5-4b5e-9f96-cad6d0b1b8f1 tempest-TestShelveInstance-736009815 None] Created volume successfully. Nov 06 10:56:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-06d4cbf6-ec8d-46e6-81d1-2264a8e11fd1 req-35b60f55-b9c4-4220-8291-efabf459520b tempest-TestShelveInstance-736009815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:56:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-06d4cbf6-ec8d-46e6-81d1-2264a8e11fd1 req-35b60f55-b9c4-4220-8291-efabf459520b tempest-TestShelveInstance-736009815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:56:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-06d4cbf6-ec8d-46e6-81d1-2264a8e11fd1 req-35b60f55-b9c4-4220-8291-efabf459520b tempest-TestShelveInstance-736009815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:56:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-06d4cbf6-ec8d-46e6-81d1-2264a8e11fd1 req-35b60f55-b9c4-4220-8291-efabf459520b tempest-TestShelveInstance-736009815 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-ab0806c1-8c06-4c12-b0d7-1af053a302df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e640a3a4-0d88-433c-a7fc-b195cca97945', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:56:12 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-06d4cbf6-ec8d-46e6-81d1-2264a8e11fd1 req-35b60f55-b9c4-4220-8291-efabf459520b tempest-TestShelveInstance-736009815 None] attachment_update completed successfully. Nov 06 10:56:22 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=20,cinder:INSERT=6,cinder:UPDATE=7 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:56:22 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=6,cinder:SELECT=13,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:56:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:56:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:56:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:56:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:56:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:56:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:56:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:56:36 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:56:36 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:56:36 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Nov 06 10:56:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.260s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:56:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:56:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:56:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 29 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:56:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:56:44 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-310cf17b-bd7e-4bde-998a-293a39fe1c82 req-a2543f9c-e3cd-4743-b831-04debc4be713 tempest-TestShelveInstance-736009815 None] Terminate volume connection completed successfully. Nov 06 10:56:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-310cf17b-bd7e-4bde-998a-293a39fe1c82 req-a2543f9c-e3cd-4743-b831-04debc4be713 tempest-TestShelveInstance-736009815 None] Deleting attachment e640a3a4-0d88-433c-a7fc-b195cca97945. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:56:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-9105002e-0a35-4232-8115-9a4a50b40e20 req-d9fa53ce-657a-4e11-9cd2-a3d1b8ded194 tempest-TestShelveInstance-736009815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:56:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-9105002e-0a35-4232-8115-9a4a50b40e20 req-d9fa53ce-657a-4e11-9cd2-a3d1b8ded194 tempest-TestShelveInstance-736009815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:56:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-9105002e-0a35-4232-8115-9a4a50b40e20 req-d9fa53ce-657a-4e11-9cd2-a3d1b8ded194 tempest-TestShelveInstance-736009815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:56:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-9105002e-0a35-4232-8115-9a4a50b40e20 req-d9fa53ce-657a-4e11-9cd2-a3d1b8ded194 tempest-TestShelveInstance-736009815 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049', 'name': 'volume-ab0806c1-8c06-4c12-b0d7-1af053a302df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7130658-ddc2-4e24-a525-706336a82cb9', 'enforce_multipath': True} {{(pid=86819) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 10:56:46 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-9105002e-0a35-4232-8115-9a4a50b40e20 req-d9fa53ce-657a-4e11-9cd2-a3d1b8ded194 tempest-TestShelveInstance-736009815 None] attachment_update completed successfully. Nov 06 10:56:56 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:56:56 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=9 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:57:29 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-f712636e-f323-48c5-be1b-8e41551ae9be req-f4660380-1401-475c-a35c-efe9b09fd704 tempest-TestShelveInstance-736009815 None] Terminate volume connection completed successfully. Nov 06 10:57:29 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [req-f712636e-f323-48c5-be1b-8e41551ae9be req-f4660380-1401-475c-a35c-efe9b09fd704 tempest-TestShelveInstance-736009815 None] Deleting attachment e7130658-ddc2-4e24-a525-706336a82cb9. {{(pid=86819) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 10:57:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Acquiring lock "cinder-ab0806c1-8c06-4c12-b0d7-1af053a302df-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:57:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Lock "cinder-ab0806c1-8c06-4c12-b0d7-1af053a302df-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:57:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Acquiring lock "cinder-quobyte-ab0806c1-8c06-4c12-b0d7-1af053a302df" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:57:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Lock "cinder-quobyte-ab0806c1-8c06-4c12-b0d7-1af053a302df" acquired by "delete_volume" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:57:29 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dedf6d9-3810-4f6b-9bc1-a04c85f05bb8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:57:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:57:29 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df Nov 06 10:57:29 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:57:29 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Nov 06 10:57:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df" returned: 0 in 0.381s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:57:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:57:30 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df Nov 06 10:57:30 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:57:30 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Nov 06 10:57:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ab0806c1-8c06-4c12-b0d7-1af053a302df" returned: 0 in 0.236s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:57:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Lock "cinder-quobyte-ab0806c1-8c06-4c12-b0d7-1af053a302df" released by "delete_volume" :: held 0.664s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:57:30 devstack cinder-volume[86819]: DEBUG cinder.quota [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Created reservations ['bebc2412-f583-45cb-a274-1ecadbab51d9', '6d74fff6-872a-4881-bc41-fab1936d7fd7', '94a32244-1648-45b8-b501-98834a77179b', 'd58eeb31-ff1f-4baa-87b7-52536dafb5ae'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:57:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:57:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:57:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:57:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:57:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:57:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:57:30 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:57:30 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:57:30 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 06 10:57:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.260s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:57:30 devstack cinder-volume[86819]: DEBUG cinder.manager [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:57:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Deleted volume successfully. Nov 06 10:57:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [req-f712636e-f323-48c5-be1b-8e41551ae9be req-336f8426-598b-43e7-91ae-bb9d6aaa1704 tempest-TestShelveInstance-736009815 None] Lock "cinder-ab0806c1-8c06-4c12-b0d7-1af053a302df-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:57:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:57:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:57:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:57:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:57:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:57:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:57:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:57:36 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:57:36 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:57:36 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Nov 06 10:57:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.251s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:57:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:57:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:57:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 29 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:57:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:57:40 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:57:40 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Flow 'volume_create_manager' (9fd0add7-b0e7-4f5a-ba21-ec9b1ba17e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf58d39-7e90-4edb-aaa9-8c6ac3186596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf58d39-7e90-4edb-aaa9-8c6ac3186596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-769020345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c055f2d-51b3-4ec4-bec5-15b4ad63d405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45a42cb8bc5544b5b0fe89b1d21fb123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:58:00Z,use_quota=True,user_id='e6ca4a6c5f5d4a01b37b95a4e8f8bdf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee70653b-40f9-4ac8-beca-5e21ff5bbc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee70653b-40f9-4ac8-beca-5e21ff5bbc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba18112-e7d8-49ee-be36-dbbf32c3e233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba18112-e7d8-49ee-be36-dbbf32c3e233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c055f2d-51b3-4ec4-bec5-15b4ad63d405', 'volume_name': 'volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25d6a6b-5708-4552-b953-8b1c68f3c2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25d6a6b-5708-4552-b953-8b1c68f3c2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5d6b01-98bf-4cf2-8f29-dedbfeebdb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:57:59 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Volume 6c055f2d-51b3-4ec4-bec5-15b4ad63d405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405', 'volume_size': 1} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-769020345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c055f2d-51b3-4ec4-bec5-15b4ad63d405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45a42cb8bc5544b5b0fe89b1d21fb123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:58:00Z,use_quota=True,user_id='e6ca4a6c5f5d4a01b37b95a4e8f8bdf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Creating volume 6c055f2d-51b3-4ec4-bec5-15b4ad63d405 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:57:59 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:57:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:57:59 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 1073741824 Nov 06 10:57:59 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:00 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 1073741824" returned: 0 in 0.428s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:00 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 Nov 06 10:58:00 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:00 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405" returned: 0 in 0.247s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:58:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:58:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5d6b01-98bf-4cf2-8f29-dedbfeebdb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729fa120-982b-464d-8a8a-573f1aa6c756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:00 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Volume volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 (6c055f2d-51b3-4ec4-bec5-15b4ad63d405): created successfully Nov 06 10:58:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729fa120-982b-464d-8a8a-573f1aa6c756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Flow 'volume_create_manager' (9fd0add7-b0e7-4f5a-ba21-ec9b1ba17e50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:58:00 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-810c8f0a-a654-4fa7-a122-6bc4f2979147 tempest-TestImageHashVerification-724416089 None] Created volume successfully. Nov 06 10:58:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:58:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:58:01 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8348b33-29df-448b-8d74-77bc81e1facc]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:58:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:01 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 Nov 06 10:58:01 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:02 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405" returned: 0 in 0.380s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:02 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d218a027-aca4-49d3-98f2-73dc1f94893c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:58:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:02 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 Nov 06 10:58:02 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:02 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405" returned: 0 in 0.353s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 /opt/stack/data/cinder/conversion/6c055f2d-51b3-4ec4-bec5-15b4ad63d405.temp_image.ff1b554b-aaed-4eb7-bdff-81b00a029ee5sd8pv07z.img {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:02 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 /opt/stack/data/cinder/conversion/6c055f2d-51b3-4ec4-bec5-15b4ad63d405.temp_image.ff1b554b-aaed-4eb7-bdff-81b00a029ee5sd8pv07z.img Nov 06 10:58:02 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:07 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 /opt/stack/data/cinder/conversion/6c055f2d-51b3-4ec4-bec5-15b4ad63d405.temp_image.ff1b554b-aaed-4eb7-bdff-81b00a029ee5sd8pv07z.img" returned: 0 in 5.613s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:08 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c62eb90-3492-4f0d-9f97-140a9c339237]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:58:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:08 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 Nov 06 10:58:08 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:08 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405" returned: 0 in 0.515s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:08 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] Image conversion details: src /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/conversion/6c055f2d-51b3-4ec4-bec5-15b4ad63d405.temp_image.ff1b554b-aaed-4eb7-bdff-81b00a029ee5sd8pv07z.img {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:58:08 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] Converted 1024.00 MB image at 182.39 MB/s Nov 06 10:58:08 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] ff1b554b-aaed-4eb7-bdff-81b00a029ee5 was raw, no need to convert to raw {{(pid=86819) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1180}} Nov 06 10:58:19 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:58:19 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:58:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.844s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:58:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] Uploaded volume to glance image-id: ff1b554b-aaed-4eb7-bdff-81b00a029ee5. {{(pid=86819) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 10:58:26 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2132a71e-94a5-436a-9823-3b2b239d1bee tempest-TestImageHashVerification-724416089 None] Copy volume to image completed successfully. Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Acquiring lock "cinder-6c055f2d-51b3-4ec4-bec5-15b4ad63d405-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Lock "cinder-6c055f2d-51b3-4ec4-bec5-15b4ad63d405-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Acquiring lock "cinder-quobyte-6c055f2d-51b3-4ec4-bec5-15b4ad63d405" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Lock "cinder-quobyte-6c055f2d-51b3-4ec4-bec5-15b4ad63d405" acquired by "delete_volume" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7abfa7-cf92-4944-b6df-7724c0a35fcd]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:27 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 Nov 06 10:58:27 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:27 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405" returned: 0 in 0.348s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:27 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405 Nov 06 10:58:27 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:27 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c055f2d-51b3-4ec4-bec5-15b4ad63d405" returned: 0 in 0.237s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Lock "cinder-quobyte-6c055f2d-51b3-4ec4-bec5-15b4ad63d405" released by "delete_volume" :: held 0.629s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Created reservations ['9bf670cd-1945-4ab3-b83a-00cd423cbc09', '2938ac99-056f-4387-b0c5-d56eb436c403', 'ff55bd2f-1768-48d9-bc3c-e123cdd377c9', '8177cd1c-c198-439b-a95e-bf40ad956276'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:58:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:27 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:58:27 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:28 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.268s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:28 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:58:28 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Deleted volume successfully. Nov 06 10:58:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-68b28957-a0b4-47d9-a091-76a9536fa3bf tempest-TestImageHashVerification-724416089 None] Lock "cinder-6c055f2d-51b3-4ec4-bec5-15b4ad63d405-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:58:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:58:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:58:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:58:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:58:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:58:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:58:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:36 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:58:36 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:36 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.248s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:58:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:58:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 29 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:58:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:58:37 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Flow 'volume_create_manager' (d1753945-5600-4729-ae1a-e9176052a233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952ca2aa-a1ee-46d1-82b6-cdb02324142c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952ca2aa-a1ee-46d1-82b6-cdb02324142c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1445571128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a434712-f034-4711-a883-16f175c9bcd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6009df3a3bbb48c98d82d887fbd75ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:58:39Z,use_quota=True,user_id='2a253ebe7deb417d941a226a2ff410bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d96154b-1b16-4d22-bfb4-4270256d659c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d96154b-1b16-4d22-bfb4-4270256d659c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21841ba8-61c9-4b49-9498-f6cd2cf38cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21841ba8-61c9-4b49-9498-f6cd2cf38cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a434712-f034-4711-a883-16f175c9bcd0', 'volume_name': 'volume-0a434712-f034-4711-a883-16f175c9bcd0', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da0ef67-2905-4067-abbc-fa5657406b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da0ef67-2905-4067-abbc-fa5657406b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5317799-abf4-4bb7-93a3-41933d97325c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:38 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Volume 0a434712-f034-4711-a883-16f175c9bcd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a434712-f034-4711-a883-16f175c9bcd0', 'volume_size': 1} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1445571128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a434712-f034-4711-a883-16f175c9bcd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6009df3a3bbb48c98d82d887fbd75ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:58:39Z,use_quota=True,user_id='2a253ebe7deb417d941a226a2ff410bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Creating volume 0a434712-f034-4711-a883-16f175c9bcd0 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:58:38 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:58:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:39 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 1073741824 Nov 06 10:58:39 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:39 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 1073741824" returned: 0 in 0.409s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:39 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 Nov 06 10:58:39 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:39 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0" returned: 0 in 0.250s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:39 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:58:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:58:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5317799-abf4-4bb7-93a3-41933d97325c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a434712-f034-4711-a883-16f175c9bcd0', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe1ee3b-a082-4c07-9ef2-46f093dc8781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:39 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Volume volume-0a434712-f034-4711-a883-16f175c9bcd0 (0a434712-f034-4711-a883-16f175c9bcd0): created successfully Nov 06 10:58:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe1ee3b-a082-4c07-9ef2-46f093dc8781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Flow 'volume_create_manager' (d1753945-5600-4729-ae1a-e9176052a233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:58:39 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-3e59239a-f790-4491-bdeb-1ee2abe3411c tempest-VolumeDependencyTests-466815898 None] Created volume successfully. Nov 06 10:58:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:58:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:58:40 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] Creating offline snapshot fe8ca90c-4e21-45b0-9f9b-94ea3f599705 of volume 0a434712-f034-4711-a883-16f175c9bcd0 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:58:40 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0983b7a-c252-4cc0-8705-1a741806a6ec]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:58:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:40 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 Nov 06 10:58:40 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:40 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0" returned: 0 in 0.357s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:40 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 1G Nov 06 10:58:40 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:40 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 1G" returned: 0 in 0.382s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a434712-f034-4711-a883-16f175c9bcd0 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:40 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a434712-f034-4711-a883-16f175c9bcd0 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 Nov 06 10:58:40 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:41 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a434712-f034-4711-a883-16f175c9bcd0 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705" returned: 0 in 0.288s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:41 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 is being set with open permissions: ugo+rw Nov 06 10:58:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:41 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 Nov 06 10:58:41 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:41 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705" returned: 0 in 0.249s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:41 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.info Nov 06 10:58:41 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:41 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.info" returned: 0 in 0.258s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:41 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.info is being set with open permissions: ugo+rw Nov 06 10:58:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:41 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.info Nov 06 10:58:41 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:41 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.info" returned: 0 in 0.239s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:58:41 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-dd3f63c5-c861-4c8b-9cbb-12d9b6d637ba tempest-VolumeDependencyTests-466815898 None] Create snapshot completed successfully Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Flow 'volume_create_manager' (ad6943c3-dcec-4b50-ab8a-12b1cb97ae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5037a486-e123-49f8-8183-8b9703c99f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5037a486-e123-49f8-8183-8b9703c99f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1995187836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52319afb-38c0-4505-b5ff-986678fc365a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6009df3a3bbb48c98d82d887fbd75ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe8ca90c-4e21-45b0-9f9b-94ea3f599705,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:58:43Z,use_quota=True,user_id='2a253ebe7deb417d941a226a2ff410bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a9dbc4-75ef-45a9-aadc-48b4d61495d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a9dbc4-75ef-45a9-aadc-48b4d61495d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8a8ddf-aabc-43ee-a31b-49c5c1cb1012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8a8ddf-aabc-43ee-a31b-49c5c1cb1012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '52319afb-38c0-4505-b5ff-986678fc365a', 'volume_name': 'volume-52319afb-38c0-4505-b5ff-986678fc365a', 'volume_size': 1, 'snapshot_id': 'fe8ca90c-4e21-45b0-9f9b-94ea3f599705'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614b7f6b-0908-462b-9ebd-f19ff135a77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614b7f6b-0908-462b-9ebd-f19ff135a77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ae0cf6-2455-4f16-b3a3-f50787400fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:42 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Volume 52319afb-38c0-4505-b5ff-986678fc365a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-52319afb-38c0-4505-b5ff-986678fc365a', 'volume_size': 1, 'snapshot_id': 'fe8ca90c-4e21-45b0-9f9b-94ea3f599705'} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Acquiring lock "cinder-quobyte-fe8ca90c-4e21-45b0-9f9b-94ea3f599705-52319afb-38c0-4505-b5ff-986678fc365a" by "_create_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Lock "cinder-quobyte-fe8ca90c-4e21-45b0-9f9b-94ea3f599705-52319afb-38c0-4505-b5ff-986678fc365a" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Creating volume 52319afb-38c0-4505-b5ff-986678fc365a from snapshot fe8ca90c-4e21-45b0-9f9b-94ea3f599705 {{(pid=86819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Acquiring lock "cinder-quobyte-52319afb-38c0-4505-b5ff-986678fc365a" by "_copy_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Lock "cinder-quobyte-52319afb-38c0-4505-b5ff-986678fc365a" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] snapshot: fe8ca90c-4e21-45b0-9f9b-94ea3f599705, volume: 52319afb-38c0-4505-b5ff-986678fc365a, {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61dd9da-e34d-43b3-ba94-6fee3b5831ca]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:58:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:42 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 Nov 06 10:58:42 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:43 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705" returned: 0 in 0.351s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a434712-f034-4711-a883-16f175c9bcd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:58:43 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac1573e-264a-4171-b024-88754c27d716]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:58:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:43 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 Nov 06 10:58:43 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:43 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0" returned: 0 in 0.360s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] will copy from snapshot at /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 10:58:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Creating direct copy from snapshot {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 10:58:43 devstack cinder-volume[86819]: DEBUG cinder.utils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Path /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-52319afb-38c0-4505-b5ff-986678fc365a not found in is_blk_device check {{(pid=86819) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 10:58:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-52319afb-38c0-4505-b5ff-986678fc365a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:43 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-52319afb-38c0-4505-b5ff-986678fc365a Nov 06 10:58:43 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:49 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-52319afb-38c0-4505-b5ff-986678fc365a" returned: 0 in 5.879s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:49 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Image conversion details: src /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-52319afb-38c0-4505-b5ff-986678fc365a {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:58:49 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Converted 1024.00 MB image at 174.13 MB/s Nov 06 10:58:49 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-52319afb-38c0-4505-b5ff-986678fc365a is being set with open permissions: ugo+rw Nov 06 10:58:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-52319afb-38c0-4505-b5ff-986678fc365a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:49 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-52319afb-38c0-4505-b5ff-986678fc365a Nov 06 10:58:49 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:49 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-52319afb-38c0-4505-b5ff-986678fc365a" returned: 0 in 0.243s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Lock "cinder-quobyte-52319afb-38c0-4505-b5ff-986678fc365a" released by "_copy_volume_from_snapshot" :: held 6.919s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:58:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Lock "cinder-quobyte-fe8ca90c-4e21-45b0-9f9b-94ea3f599705-52319afb-38c0-4505-b5ff-986678fc365a" released by "_create_volume_from_snapshot" :: held 6.981s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:58:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.996s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:58:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ae0cf6-2455-4f16-b3a3-f50787400fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52319afb-38c0-4505-b5ff-986678fc365a', 'volume_size': 1, 'snapshot_id': 'fe8ca90c-4e21-45b0-9f9b-94ea3f599705'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8b745a-10ac-4d27-8645-e94f372d18ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:49 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Volume volume-52319afb-38c0-4505-b5ff-986678fc365a (52319afb-38c0-4505-b5ff-986678fc365a): created successfully Nov 06 10:58:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8b745a-10ac-4d27-8645-e94f372d18ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Flow 'volume_create_manager' (ad6943c3-dcec-4b50-ab8a-12b1cb97ae47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:58:49 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-8a52088a-81bc-4866-933e-696c63ef4ec4 tempest-VolumeDependencyTests-466815898 None] Created volume successfully. Nov 06 10:58:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Acquiring lock "cinder-fe8ca90c-4e21-45b0-9f9b-94ea3f599705-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:58:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Lock "cinder-fe8ca90c-4e21-45b0-9f9b-94ea3f599705-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:58:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Acquiring lock "cinder-quobyte-0a434712-f034-4711-a883-16f175c9bcd0" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:58:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Lock "cinder-quobyte-0a434712-f034-4711-a883-16f175c9bcd0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:58:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Acquiring lock "cinder-quobyte-fe8ca90c-4e21-45b0-9f9b-94ea3f599705" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:58:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Lock "cinder-quobyte-fe8ca90c-4e21-45b0-9f9b-94ea3f599705" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:58:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Deleting offline snapshot fe8ca90c-4e21-45b0-9f9b-94ea3f599705 of volume 0a434712-f034-4711-a883-16f175c9bcd0 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:58:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] snapshot_file for this snap is: volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:58:50 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9559f1dc-b3b9-4528-b6e3-91f53b293dd6]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:58:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:50 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 Nov 06 10:58:50 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:50 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705" returned: 0 in 0.361s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a434712-f034-4711-a883-16f175c9bcd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:58:50 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[051831cb-dfc1-4891-8a4b-870f9eca40e3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:58:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:50 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 Nov 06 10:58:50 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:51 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0" returned: 0 in 0.533s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:51 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 Nov 06 10:58:51 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:51 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705" returned: 0 in 0.335s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:51 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705 Nov 06 10:58:51 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:51 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0.fe8ca90c-4e21-45b0-9f9b-94ea3f599705" returned: 0 in 0.244s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Lock "cinder-quobyte-fe8ca90c-4e21-45b0-9f9b-94ea3f599705" released by "_delete_snapshot" :: held 1.573s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:58:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Lock "cinder-quobyte-0a434712-f034-4711-a883-16f175c9bcd0" released by "delete_snapshot" :: held 1.593s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:58:51 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Created reservations ['8355cae5-062f-4e65-8855-a4175c802fff', 'e4d07857-1f53-48c6-a191-c14166db65b3', '4d6cb238-942f-41b7-8eb2-819ccb9cad83', 'cf692314-2c98-4a3d-9a4d-784c533884ec'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:58:51 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Delete snapshot completed successfully. Nov 06 10:58:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-acccdb33-ee45-4432-88ad-cb6edc0074da tempest-VolumeDependencyTests-466815898 None] Lock "cinder-fe8ca90c-4e21-45b0-9f9b-94ea3f599705-delete_snapshot" released by "delete_snapshot" :: held 1.715s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:58:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Acquiring lock "cinder-0a434712-f034-4711-a883-16f175c9bcd0-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:58:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Lock "cinder-0a434712-f034-4711-a883-16f175c9bcd0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:58:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Acquiring lock "cinder-quobyte-0a434712-f034-4711-a883-16f175c9bcd0" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:58:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Lock "cinder-quobyte-0a434712-f034-4711-a883-16f175c9bcd0" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:58:52 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[6605d006-a5ff-4707-824e-a7278c26c97d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:58:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:52 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 Nov 06 10:58:52 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:52 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0" returned: 0 in 0.355s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:52 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0 Nov 06 10:58:52 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:52 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-0a434712-f034-4711-a883-16f175c9bcd0" returned: 0 in 0.240s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Lock "cinder-quobyte-0a434712-f034-4711-a883-16f175c9bcd0" released by "delete_volume" :: held 0.658s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Created reservations ['4b2798f0-c618-4d23-986d-db0ff1dd200f', '9efd64dc-aa7a-44e4-9f97-e5078c0baedd', 'a3f17458-6f14-46ea-a6c7-4b5c1793d1db', '5b7fbeed-8b34-4fc7-a706-07f897f5891d'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:53 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:58:53 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:53 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.248s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:58:53 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Deleted volume successfully. Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-a5b79f28-3735-4243-bde3-0f9dea395f2f tempest-VolumeDependencyTests-466815898 None] Lock "cinder-0a434712-f034-4711-a883-16f175c9bcd0-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Acquiring lock "cinder-52319afb-38c0-4505-b5ff-986678fc365a-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Lock "cinder-52319afb-38c0-4505-b5ff-986678fc365a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Acquiring lock "cinder-quobyte-52319afb-38c0-4505-b5ff-986678fc365a" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Lock "cinder-quobyte-52319afb-38c0-4505-b5ff-986678fc365a" acquired by "delete_volume" :: waited 0.014s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3566362f-4248-4027-9e75-71155a45a0ea]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-52319afb-38c0-4505-b5ff-986678fc365a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:53 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-52319afb-38c0-4505-b5ff-986678fc365a Nov 06 10:58:53 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:53 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-52319afb-38c0-4505-b5ff-986678fc365a" returned: 0 in 0.356s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-52319afb-38c0-4505-b5ff-986678fc365a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:53 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-52319afb-38c0-4505-b5ff-986678fc365a Nov 06 10:58:53 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:54 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-52319afb-38c0-4505-b5ff-986678fc365a" returned: 0 in 0.239s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Lock "cinder-quobyte-52319afb-38c0-4505-b5ff-986678fc365a" released by "delete_volume" :: held 0.642s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:58:54 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Created reservations ['afe2b25a-d22f-474c-9440-55102b8dad24', 'cd2d2a16-73a7-4cd9-bc6a-3e05c3567898', '894d5e23-461b-474f-87eb-ad48b1de7a85', '4b5c18de-d77d-4442-908a-2fa7bf218f6b'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:58:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:58:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:58:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:58:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:58:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:58:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:54 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:58:54 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:54 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.245s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:54 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:58:54 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Deleted volume successfully. Nov 06 10:58:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-db91bd89-5bd5-41ad-8ddd-aebc87e3ed39 tempest-VolumeDependencyTests-466815898 None] Lock "cinder-52319afb-38c0-4505-b5ff-986678fc365a-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Flow 'volume_create_manager' (66854ece-e682-4a78-a7cb-1f1a3bf6dc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c4edae-e3e9-40b3-a777-d86aa8d03ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c4edae-e3e9-40b3-a777-d86aa8d03ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-706558127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad47991e-58a4-4cda-b8a2-f9aadb5760c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4269f92d9df548408fa2d823ff4b95d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:58:58Z,use_quota=True,user_id='e730cd3bbe9b4b6d94a9cd87e96254bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cf1227-7ef4-49e8-8e04-e58f4a2a94be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cf1227-7ef4-49e8-8e04-e58f4a2a94be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215128e6-14ec-4fc2-a144-f4ad26f9d434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215128e6-14ec-4fc2-a144-f4ad26f9d434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad47991e-58a4-4cda-b8a2-f9aadb5760c8', 'volume_name': 'volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bfee669-1544-4003-bfc4-77500fbc0eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bfee669-1544-4003-bfc4-77500fbc0eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee90700b-b9f6-4bb0-9943-b0b24827c68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:57 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Volume ad47991e-58a4-4cda-b8a2-f9aadb5760c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8', 'volume_size': 1} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-706558127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad47991e-58a4-4cda-b8a2-f9aadb5760c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4269f92d9df548408fa2d823ff4b95d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:58:58Z,use_quota=True,user_id='e730cd3bbe9b4b6d94a9cd87e96254bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Creating volume ad47991e-58a4-4cda-b8a2-f9aadb5760c8 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:58:57 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:58:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:57 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8 1073741824 Nov 06 10:58:57 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:58 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8 1073741824" returned: 0 in 0.394s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:58 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8 Nov 06 10:58:58 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:58 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8" returned: 0 in 0.247s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:58:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:58:58 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee90700b-b9f6-4bb0-9943-b0b24827c68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:58 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e500334e-fd67-410b-845a-f19cb3067b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:58:58 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Volume volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8 (ad47991e-58a4-4cda-b8a2-f9aadb5760c8): created successfully Nov 06 10:58:58 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e500334e-fd67-410b-845a-f19cb3067b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:58:58 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Flow 'volume_create_manager' (66854ece-e682-4a78-a7cb-1f1a3bf6dc17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:58:58 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-35d359a4-2341-4804-aba2-1de04ab57b99 tempest-ProjectReaderTests-604800153 None] Created volume successfully. Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Acquiring lock "cinder-ad47991e-58a4-4cda-b8a2-f9aadb5760c8-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Lock "cinder-ad47991e-58a4-4cda-b8a2-f9aadb5760c8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Acquiring lock "cinder-quobyte-ad47991e-58a4-4cda-b8a2-f9aadb5760c8" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Lock "cinder-quobyte-ad47991e-58a4-4cda-b8a2-f9aadb5760c8" acquired by "delete_volume" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0854bb0-4391-4f2a-8141-8ac734a2afb7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:59 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8 Nov 06 10:58:59 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:59 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8" returned: 0 in 0.354s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:59 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8 Nov 06 10:58:59 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:58:59 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ad47991e-58a4-4cda-b8a2-f9aadb5760c8" returned: 0 in 0.244s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Lock "cinder-quobyte-ad47991e-58a4-4cda-b8a2-f9aadb5760c8" released by "delete_volume" :: held 0.637s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Created reservations ['0c59181f-453b-4f3f-b626-02e70c509b34', 'fa475528-33fe-412f-8887-69bcc4be0437', '3837c990-52b5-4897-bc71-2e8f836bb76b', '4bfbb681-b37f-45b3-9b36-7f122fe59595'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:58:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:58:59 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:58:59 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:00 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.237s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:00 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Deleted volume successfully. Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c565db29-3bd3-42c7-901d-617a18766525 tempest-ProjectReaderTests-604800153 None] Lock "cinder-ad47991e-58a4-4cda-b8a2-f9aadb5760c8-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Flow 'volume_create_manager' (298264c7-7a55-4b6e-9f16-c85c98e0bfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf003fc-5fe4-4f69-89ef-56c2bc4e404a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf003fc-5fe4-4f69-89ef-56c2bc4e404a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264724909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c47328f-8db8-4ed7-93e2-10dd9cc4939e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4269f92d9df548408fa2d823ff4b95d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:01Z,use_quota=True,user_id='e730cd3bbe9b4b6d94a9cd87e96254bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09cb969a-3800-4664-8925-fafbd9daba97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09cb969a-3800-4664-8925-fafbd9daba97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0798cf49-9fc4-46a2-8834-ba0171968233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0798cf49-9fc4-46a2-8834-ba0171968233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c47328f-8db8-4ed7-93e2-10dd9cc4939e', 'volume_name': 'volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b788258-bded-4465-a58e-e3965573d32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b788258-bded-4465-a58e-e3965573d32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9181b76e-9966-4086-a63e-ce8910a6938f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:00 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Volume 5c47328f-8db8-4ed7-93e2-10dd9cc4939e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e', 'volume_size': 1} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264724909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c47328f-8db8-4ed7-93e2-10dd9cc4939e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4269f92d9df548408fa2d823ff4b95d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:01Z,use_quota=True,user_id='e730cd3bbe9b4b6d94a9cd87e96254bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Creating volume 5c47328f-8db8-4ed7-93e2-10dd9cc4939e {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:00 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:00 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e 1073741824 Nov 06 10:59:00 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:01 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e 1073741824" returned: 0 in 0.401s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:01 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e Nov 06 10:59:01 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:01 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e" returned: 0 in 0.259s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9181b76e-9966-4086-a63e-ce8910a6938f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3aa7302-d2d6-428c-b41d-e33fa60e73a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:01 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Volume volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e (5c47328f-8db8-4ed7-93e2-10dd9cc4939e): created successfully Nov 06 10:59:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3aa7302-d2d6-428c-b41d-e33fa60e73a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Flow 'volume_create_manager' (298264c7-7a55-4b6e-9f16-c85c98e0bfda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:01 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-de8c5909-1627-4ade-81ad-9b2f2d46a447 tempest-ProjectReaderTests-604800153 None] Created volume successfully. Nov 06 10:59:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Acquiring lock "cinder-5c47328f-8db8-4ed7-93e2-10dd9cc4939e-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Lock "cinder-5c47328f-8db8-4ed7-93e2-10dd9cc4939e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Acquiring lock "cinder-quobyte-5c47328f-8db8-4ed7-93e2-10dd9cc4939e" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Lock "cinder-quobyte-5c47328f-8db8-4ed7-93e2-10dd9cc4939e" acquired by "delete_volume" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:01 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c9199e-6d66-46e0-a8f0-2de838a21248]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:01 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e Nov 06 10:59:01 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:02 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e" returned: 0 in 0.387s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:02 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e Nov 06 10:59:02 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:02 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5c47328f-8db8-4ed7-93e2-10dd9cc4939e" returned: 0 in 0.259s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Lock "cinder-quobyte-5c47328f-8db8-4ed7-93e2-10dd9cc4939e" released by "delete_volume" :: held 0.691s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:02 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Created reservations ['d5ea14c5-90f9-4223-8536-5e07b7af090c', '1b1c97e5-b506-47ae-895b-e680da09911b', '33d786d1-19d3-4efa-8cb6-fb5957c8119c', '1876c18f-0aa0-4f70-96a2-f74749195206'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:02 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:02 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:02 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.246s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:02 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:02 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Deleted volume successfully. Nov 06 10:59:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9f0b74d5-7332-434f-8ce0-7caf038c3a31 tempest-ProjectReaderTests-604800153 None] Lock "cinder-5c47328f-8db8-4ed7-93e2-10dd9cc4939e-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Flow 'volume_create_manager' (68c9eff7-b8c3-4548-8933-b4c491231dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13e61ea-871c-4de8-8d5c-0164fd25396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13e61ea-871c-4de8-8d5c-0164fd25396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1835790819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8439a40-cdc8-4950-bfb1-f82e3737c69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4269f92d9df548408fa2d823ff4b95d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:03Z,use_quota=True,user_id='e730cd3bbe9b4b6d94a9cd87e96254bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0069f9fe-ceea-40b3-af8b-64e65cea54fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0069f9fe-ceea-40b3-af8b-64e65cea54fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71981f8-4ef9-4466-9dcb-d1c2468ecf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71981f8-4ef9-4466-9dcb-d1c2468ecf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8439a40-cdc8-4950-bfb1-f82e3737c69e', 'volume_name': 'volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ba0061-d850-4c7d-b13d-446961edbf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ba0061-d850-4c7d-b13d-446961edbf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8366167-0a0f-4876-a0c3-62cc360d5fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:03 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Volume c8439a40-cdc8-4950-bfb1-f82e3737c69e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e', 'volume_size': 1} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1835790819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8439a40-cdc8-4950-bfb1-f82e3737c69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4269f92d9df548408fa2d823ff4b95d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:03Z,use_quota=True,user_id='e730cd3bbe9b4b6d94a9cd87e96254bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Creating volume c8439a40-cdc8-4950-bfb1-f82e3737c69e {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:03 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:03 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e 1073741824 Nov 06 10:59:03 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:03 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e 1073741824" returned: 0 in 0.403s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:03 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e Nov 06 10:59:03 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:04 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e" returned: 0 in 0.242s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8366167-0a0f-4876-a0c3-62cc360d5fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b34e05-e658-47e0-ab6e-d42e742cd30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:04 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Volume volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e (c8439a40-cdc8-4950-bfb1-f82e3737c69e): created successfully Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b34e05-e658-47e0-ab6e-d42e742cd30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Flow 'volume_create_manager' (68c9eff7-b8c3-4548-8933-b4c491231dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:04 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-3f1248cd-dec7-49a6-b4f0-5cbe3d37050e tempest-ProjectReaderTests-604800153 None] Created volume successfully. Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Acquiring lock "cinder-c8439a40-cdc8-4950-bfb1-f82e3737c69e-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Lock "cinder-c8439a40-cdc8-4950-bfb1-f82e3737c69e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Acquiring lock "cinder-quobyte-c8439a40-cdc8-4950-bfb1-f82e3737c69e" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Lock "cinder-quobyte-c8439a40-cdc8-4950-bfb1-f82e3737c69e" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[05481469-3b09-4953-991c-5a0f93d8c774]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:04 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e Nov 06 10:59:04 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:04 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e" returned: 0 in 0.349s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:04 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e Nov 06 10:59:04 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:04 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c8439a40-cdc8-4950-bfb1-f82e3737c69e" returned: 0 in 0.240s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Lock "cinder-quobyte-c8439a40-cdc8-4950-bfb1-f82e3737c69e" released by "delete_volume" :: held 0.629s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Created reservations ['b2244e00-b0ae-4abb-94eb-fafb68057839', 'a80d3ba4-457e-46db-81f7-854d211a3335', '3f774698-f732-4f35-9c15-4be0ff374664', 'b83d56fe-6f33-47ff-b067-087658b862e9'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:05 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:05 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:05 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.236s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:05 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Deleted volume successfully. Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b917a110-72c4-4e58-87c0-4ee524f50241 tempest-ProjectReaderTests-604800153 None] Lock "cinder-c8439a40-cdc8-4950-bfb1-f82e3737c69e-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Flow 'volume_create_manager' (b2e8b443-f9e1-4e4a-a38d-3116a00bcd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5739f0-c212-4d68-ba78-e911b3c34d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5739f0-c212-4d68-ba78-e911b3c34d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2045165504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c18ef268-4425-49fb-ba1b-073be6c1511b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4269f92d9df548408fa2d823ff4b95d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:06Z,use_quota=True,user_id='e730cd3bbe9b4b6d94a9cd87e96254bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95926841-2b7b-4146-8e5d-06b8aef3d424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95926841-2b7b-4146-8e5d-06b8aef3d424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83b6d04-f86d-48b4-a8c4-50ac99ea9848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83b6d04-f86d-48b4-a8c4-50ac99ea9848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c18ef268-4425-49fb-ba1b-073be6c1511b', 'volume_name': 'volume-c18ef268-4425-49fb-ba1b-073be6c1511b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d106203c-8d6c-4b6a-8e59-377ad06d3478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d106203c-8d6c-4b6a-8e59-377ad06d3478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68946c1-9fd0-4dbc-a83f-8a1860e7a79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:05 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Volume c18ef268-4425-49fb-ba1b-073be6c1511b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c18ef268-4425-49fb-ba1b-073be6c1511b', 'volume_size': 1} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2045165504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c18ef268-4425-49fb-ba1b-073be6c1511b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4269f92d9df548408fa2d823ff4b95d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:06Z,use_quota=True,user_id='e730cd3bbe9b4b6d94a9cd87e96254bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Creating volume c18ef268-4425-49fb-ba1b-073be6c1511b {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:05 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c18ef268-4425-49fb-ba1b-073be6c1511b 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:06 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c18ef268-4425-49fb-ba1b-073be6c1511b 1073741824 Nov 06 10:59:06 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:06 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c18ef268-4425-49fb-ba1b-073be6c1511b 1073741824" returned: 0 in 0.410s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c18ef268-4425-49fb-ba1b-073be6c1511b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:06 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c18ef268-4425-49fb-ba1b-073be6c1511b Nov 06 10:59:06 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:06 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c18ef268-4425-49fb-ba1b-073be6c1511b" returned: 0 in 0.240s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68946c1-9fd0-4dbc-a83f-8a1860e7a79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c18ef268-4425-49fb-ba1b-073be6c1511b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef30645-7079-4401-ba53-8426290c4053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:06 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Volume volume-c18ef268-4425-49fb-ba1b-073be6c1511b (c18ef268-4425-49fb-ba1b-073be6c1511b): created successfully Nov 06 10:59:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef30645-7079-4401-ba53-8426290c4053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Flow 'volume_create_manager' (b2e8b443-f9e1-4e4a-a38d-3116a00bcd82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:06 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-936fbafb-b99b-4611-bfd8-65dc00adad6e tempest-ProjectReaderTests-604800153 None] Created volume successfully. Nov 06 10:59:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Acquiring lock "cinder-c18ef268-4425-49fb-ba1b-073be6c1511b-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Lock "cinder-c18ef268-4425-49fb-ba1b-073be6c1511b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Acquiring lock "cinder-quobyte-c18ef268-4425-49fb-ba1b-073be6c1511b" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Lock "cinder-quobyte-c18ef268-4425-49fb-ba1b-073be6c1511b" acquired by "delete_volume" :: waited 0.014s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8241d077-fe05-4e26-b046-905da9be125a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c18ef268-4425-49fb-ba1b-073be6c1511b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:07 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c18ef268-4425-49fb-ba1b-073be6c1511b Nov 06 10:59:07 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:07 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c18ef268-4425-49fb-ba1b-073be6c1511b" returned: 0 in 0.355s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c18ef268-4425-49fb-ba1b-073be6c1511b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:07 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c18ef268-4425-49fb-ba1b-073be6c1511b Nov 06 10:59:07 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:07 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c18ef268-4425-49fb-ba1b-073be6c1511b" returned: 0 in 0.239s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Lock "cinder-quobyte-c18ef268-4425-49fb-ba1b-073be6c1511b" released by "delete_volume" :: held 0.636s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Created reservations ['89c1746d-565f-4eb4-ac94-131319847302', 'fd2fade6-a49f-472e-9998-9d9eb951ae5c', '170f196c-ccca-41cd-9381-4e01cc2270da', 'bccc33a6-c210-4e22-92e1-3f0307f3f2a9'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:07 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:07 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:07 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.244s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:07 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Deleted volume successfully. Nov 06 10:59:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f02cc830-18cd-42c0-9929-f5ca0da4fe4e tempest-ProjectReaderTests-604800153 None] Lock "cinder-c18ef268-4425-49fb-ba1b-073be6c1511b-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:17 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=51,cinder:UPDATE=73,cinder:INSERT=11,cinder:DELETE=5 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:59:17 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=54,cinder:UPDATE=73,cinder:DELETE=8,cinder:INSERT=24 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Flow 'volume_create_manager' (b4d6722d-e2e2-40e1-803a-aaf86a5a2884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6facacc3-eea0-42da-8cb6-c531034bdc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6facacc3-eea0-42da-8cb6-c531034bdc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-396899684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c008d030-bdb4-46a4-ad8f-c34387d4ac46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61be6b8dfb024d2b8abf454b6ea8a97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:20Z,use_quota=True,user_id='cbbe1e95b4484a499dba9adeefc3b110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a541ca-2c4f-4f47-acb1-1bf0a2139417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a541ca-2c4f-4f47-acb1-1bf0a2139417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ff8b2b-4bb7-408c-ab23-fb89ca26c7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ff8b2b-4bb7-408c-ab23-fb89ca26c7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c008d030-bdb4-46a4-ad8f-c34387d4ac46', 'volume_name': 'volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c0fa40-10d7-45e0-8644-176501cc51e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c0fa40-10d7-45e0-8644-176501cc51e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165a5a81-868c-44b9-b26c-df491f835f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:20 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Volume c008d030-bdb4-46a4-ad8f-c34387d4ac46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46', 'volume_size': 1} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-396899684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c008d030-bdb4-46a4-ad8f-c34387d4ac46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61be6b8dfb024d2b8abf454b6ea8a97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:20Z,use_quota=True,user_id='cbbe1e95b4484a499dba9adeefc3b110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Creating volume c008d030-bdb4-46a4-ad8f-c34387d4ac46 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:20 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:20 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46 1073741824 Nov 06 10:59:20 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Flow 'volume_create_manager' (e37be8eb-f1f1-49a7-8fd1-554572aa3d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2889db3-c30d-4c85-9c26-854f23c3b8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2889db3-c30d-4c85-9c26-854f23c3b8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-324367483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f189c2bd-804f-447e-ae1c-71a25c9feefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='899e32af67854da58318817e63e17bbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:20Z,use_quota=True,user_id='2c11c029581d41af9803e5aaa88abcfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02e438c-ce1d-4b4a-94f0-64676d227dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02e438c-ce1d-4b4a-94f0-64676d227dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86c9cef-bda1-4916-8143-237c2ee71d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86c9cef-bda1-4916-8143-237c2ee71d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f189c2bd-804f-447e-ae1c-71a25c9feefd', 'volume_name': 'volume-f189c2bd-804f-447e-ae1c-71a25c9feefd', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe1156d-ce8e-4762-90da-76fa45960b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe1156d-ce8e-4762-90da-76fa45960b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1775d1-5949-4998-a6aa-2b97f17e31c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:20 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Volume f189c2bd-804f-447e-ae1c-71a25c9feefd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f189c2bd-804f-447e-ae1c-71a25c9feefd', 'volume_size': 1} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Flow 'volume_create_manager' (bd707ab4-2c74-4fb4-82a7-80a733090d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735b6a0a-c24e-4c82-82dc-9e245e962923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735b6a0a-c24e-4c82-82dc-9e245e962923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-29183181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e1795d-c71f-46d2-bd12-7cc7bb252013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61be6b8dfb024d2b8abf454b6ea8a97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:21Z,use_quota=True,user_id='cbbe1e95b4484a499dba9adeefc3b110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0661c1e0-6895-4b45-bba2-e760c81e2820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0661c1e0-6895-4b45-bba2-e760c81e2820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c67f941-286d-4782-80d4-73f20063a5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c67f941-286d-4782-80d4-73f20063a5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e1795d-c71f-46d2-bd12-7cc7bb252013', 'volume_name': 'volume-65e1795d-c71f-46d2-bd12-7cc7bb252013', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05f4d69-b4d1-4821-a557-f70da27f2643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05f4d69-b4d1-4821-a557-f70da27f2643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ddf3ec-ff0c-4fde-bbb2-c6483bc1551b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Volume 65e1795d-c71f-46d2-bd12-7cc7bb252013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e1795d-c71f-46d2-bd12-7cc7bb252013', 'volume_size': 1} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Flow 'volume_create_manager' (f1ec50a3-329f-4ef6-923a-8548a29891cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed68821d-816b-472f-bd83-3e2c27477bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed68821d-816b-472f-bd83-3e2c27477bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-363294620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a4fd57-041f-4052-9df0-ea69c759a788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61be6b8dfb024d2b8abf454b6ea8a97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:21Z,use_quota=True,user_id='cbbe1e95b4484a499dba9adeefc3b110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ef0a15-f16e-4c86-b435-a88cb0c6bd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ef0a15-f16e-4c86-b435-a88cb0c6bd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca3f520-08a1-4e27-bfe5-d976f0065b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca3f520-08a1-4e27-bfe5-d976f0065b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1a4fd57-041f-4052-9df0-ea69c759a788', 'volume_name': 'volume-d1a4fd57-041f-4052-9df0-ea69c759a788', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d01c89-8cdd-45fb-a05a-7f19fd74ba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d01c89-8cdd-45fb-a05a-7f19fd74ba01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba51ef5-f6cf-4615-b166-29c460867fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Volume d1a4fd57-041f-4052-9df0-ea69c759a788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1a4fd57-041f-4052-9df0-ea69c759a788', 'volume_size': 1} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46 1073741824" returned: 0 in 0.828s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Flow 'volume_create_manager' (263da6dc-44c8-4a92-b8f8-7f1d2585e015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3f07b5-ba14-4b3f-a3a3-46ced30259e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3f07b5-ba14-4b3f-a3a3-46ced30259e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-748351545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5098f585-4a7c-426d-a721-054ab5ef08d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61be6b8dfb024d2b8abf454b6ea8a97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:21Z,use_quota=True,user_id='cbbe1e95b4484a499dba9adeefc3b110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18dc7d6-28e2-4528-b15f-480bfa50e69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18dc7d6-28e2-4528-b15f-480bfa50e69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9387a04a-376c-4b21-8b05-65dd2320f80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9387a04a-376c-4b21-8b05-65dd2320f80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5098f585-4a7c-426d-a721-054ab5ef08d7', 'volume_name': 'volume-5098f585-4a7c-426d-a721-054ab5ef08d7', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8007b37-937b-40b9-a217-f1a6159320dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8007b37-937b-40b9-a217-f1a6159320dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16b78e2-eeea-4b58-a25d-d9223f8aadf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Volume 5098f585-4a7c-426d-a721-054ab5ef08d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5098f585-4a7c-426d-a721-054ab5ef08d7', 'volume_size': 1} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:21 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46 Nov 06 10:59:21 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (c114e4ee-2008-4640-b83b-086c62a5b2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4ad326-a0e5-4239-9c28-1dcd4b757503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4ad326-a0e5-4239-9c28-1dcd4b757503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1023691248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8973c486-f133-45ea-98a5-e82872be4db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:22Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778f5a5e-ddc1-488a-a4f3-7e7fbba7f4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778f5a5e-ddc1-488a-a4f3-7e7fbba7f4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf713ba-b4bf-4d26-b096-ec9c31b8d857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf713ba-b4bf-4d26-b096-ec9c31b8d857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8973c486-f133-45ea-98a5-e82872be4db5', 'volume_name': 'volume-8973c486-f133-45ea-98a5-e82872be4db5', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a996e1a5-797b-40e9-aa19-5f97d4e0fd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a996e1a5-797b-40e9-aa19-5f97d4e0fd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dffbe0-cf7d-48fc-bd6a-a85979b92632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Volume 8973c486-f133-45ea-98a5-e82872be4db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8973c486-f133-45ea-98a5-e82872be4db5', 'volume_size': 1} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:21 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46" returned: 0 in 0.317s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.092s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-324367483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f189c2bd-804f-447e-ae1c-71a25c9feefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='899e32af67854da58318817e63e17bbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:20Z,use_quota=True,user_id='2c11c029581d41af9803e5aaa88abcfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Creating volume f189c2bd-804f-447e-ae1c-71a25c9feefd {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:21 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165a5a81-868c-44b9-b26c-df491f835f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f5abc2-dd5d-4311-a49f-38643c6b3011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:21 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd 1073741824 Nov 06 10:59:21 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:21 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Volume volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46 (c008d030-bdb4-46a4-ad8f-c34387d4ac46): created successfully Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f5abc2-dd5d-4311-a49f-38643c6b3011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Flow 'volume_create_manager' (b4d6722d-e2e2-40e1-803a-aaf86a5a2884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:22 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-819ec12b-0d65-4f37-b611-329cfbd993b1 tempest-CreateVolumesFromImageTest-1408972214 None] Created volume successfully. Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Flow 'volume_create_manager' (8a6df9bd-53b7-43f7-8a30-a51d141914e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c437a7f-dfd4-40ac-af85-b4596726e621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c437a7f-dfd4-40ac-af85-b4596726e621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1225393670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116c7ab4-e4b0-4ec8-bac0-afc541a3197b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61be6b8dfb024d2b8abf454b6ea8a97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:22Z,use_quota=True,user_id='cbbe1e95b4484a499dba9adeefc3b110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d46e29-5476-4187-ba67-d39bd0d6517a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d46e29-5476-4187-ba67-d39bd0d6517a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266aea44-93bb-4438-bc18-64604ec33a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266aea44-93bb-4438-bc18-64604ec33a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '116c7ab4-e4b0-4ec8-bac0-afc541a3197b', 'volume_name': 'volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3cd270-f6be-4d6c-9888-2265aeb5fa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3cd270-f6be-4d6c-9888-2265aeb5fa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7ee9e2-f835-4e06-88cc-cdd0ea4d5412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:22 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Volume 116c7ab4-e4b0-4ec8-bac0-afc541a3197b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b', 'volume_size': 1} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:22 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd 1073741824" returned: 0 in 0.476s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:22 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd Nov 06 10:59:22 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:22 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd" returned: 0 in 0.281s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.623s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-29183181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e1795d-c71f-46d2-bd12-7cc7bb252013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61be6b8dfb024d2b8abf454b6ea8a97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:21Z,use_quota=True,user_id='cbbe1e95b4484a499dba9adeefc3b110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Creating volume 65e1795d-c71f-46d2-bd12-7cc7bb252013 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:22 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-65e1795d-c71f-46d2-bd12-7cc7bb252013 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:22 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-65e1795d-c71f-46d2-bd12-7cc7bb252013 1073741824 Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1775d1-5949-4998-a6aa-2b97f17e31c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f189c2bd-804f-447e-ae1c-71a25c9feefd', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:22 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ec3079-f3e2-4939-80a3-4f6a75680335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:22 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Volume volume-f189c2bd-804f-447e-ae1c-71a25c9feefd (f189c2bd-804f-447e-ae1c-71a25c9feefd): created successfully Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ec3079-f3e2-4939-80a3-4f6a75680335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:22 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Flow 'volume_create_manager' (e37be8eb-f1f1-49a7-8fd1-554572aa3d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:22 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-1b5249e0-0fc3-4fd2-ad75-e0465826c5e7 tempest-VolumeDependencyTests-410797868 None] Created volume successfully. Nov 06 10:59:23 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-65e1795d-c71f-46d2-bd12-7cc7bb252013 1073741824" returned: 0 in 0.479s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-65e1795d-c71f-46d2-bd12-7cc7bb252013 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:23 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-65e1795d-c71f-46d2-bd12-7cc7bb252013 Nov 06 10:59:23 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:23 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-65e1795d-c71f-46d2-bd12-7cc7bb252013" returned: 0 in 0.272s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.136s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-363294620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a4fd57-041f-4052-9df0-ea69c759a788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61be6b8dfb024d2b8abf454b6ea8a97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:21Z,use_quota=True,user_id='cbbe1e95b4484a499dba9adeefc3b110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Creating volume d1a4fd57-041f-4052-9df0-ea69c759a788 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:23 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1a4fd57-041f-4052-9df0-ea69c759a788 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ddf3ec-ff0c-4fde-bbb2-c6483bc1551b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e1795d-c71f-46d2-bd12-7cc7bb252013', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae688b0-ec5b-4e90-8e42-8dfe5410d607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:23 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1a4fd57-041f-4052-9df0-ea69c759a788 1073741824 Nov 06 10:59:23 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:23 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Volume volume-65e1795d-c71f-46d2-bd12-7cc7bb252013 (65e1795d-c71f-46d2-bd12-7cc7bb252013): created successfully Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae688b0-ec5b-4e90-8e42-8dfe5410d607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Flow 'volume_create_manager' (bd707ab4-2c74-4fb4-82a7-80a733090d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c432a9d7-307e-4085-b7a2-a3c3cb66ce57 tempest-CreateVolumesFromImageTest-1408972214 None] Created volume successfully. Nov 06 10:59:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:24 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1a4fd57-041f-4052-9df0-ea69c759a788 1073741824" returned: 0 in 0.483s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1a4fd57-041f-4052-9df0-ea69c759a788 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:24 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1a4fd57-041f-4052-9df0-ea69c759a788 Nov 06 10:59:24 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:24 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1a4fd57-041f-4052-9df0-ea69c759a788" returned: 0 in 0.267s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.759s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-748351545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5098f585-4a7c-426d-a721-054ab5ef08d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61be6b8dfb024d2b8abf454b6ea8a97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:21Z,use_quota=True,user_id='cbbe1e95b4484a499dba9adeefc3b110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Creating volume 5098f585-4a7c-426d-a721-054ab5ef08d7 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:24 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5098f585-4a7c-426d-a721-054ab5ef08d7 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba51ef5-f6cf-4615-b166-29c460867fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1a4fd57-041f-4052-9df0-ea69c759a788', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8971f2b-6dd2-4508-ba39-4ab8811f3b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:24 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5098f585-4a7c-426d-a721-054ab5ef08d7 1073741824 Nov 06 10:59:24 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:24 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Volume volume-d1a4fd57-041f-4052-9df0-ea69c759a788 (d1a4fd57-041f-4052-9df0-ea69c759a788): created successfully Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8971f2b-6dd2-4508-ba39-4ab8811f3b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Flow 'volume_create_manager' (f1ec50a3-329f-4ef6-923a-8548a29891cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:24 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7be19d0d-6d45-4b51-9974-98990bec75c1 tempest-CreateVolumesFromImageTest-1408972214 None] Created volume successfully. Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Flow 'volume_create_manager' (18a78107-059a-404b-8999-d45a7e62e4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fe9c14-77b0-4b12-8cdf-88828aa86441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fe9c14-77b0-4b12-8cdf-88828aa86441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ffeaae-b162-4da7-9a02-97bf40c995fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c31f2132add4f1db84eda3fd58f3f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:25Z,use_quota=True,user_id='9acc98a5722a456ea863fcf3182674bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38610ccd-20a4-4adf-b0ca-e7d2e5fddf45),volume_type_id=38610ccd-20a4-4adf-b0ca-e7d2e5fddf45)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bd38e6-5683-46e8-a6b9-3530f47f0eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bd38e6-5683-46e8-a6b9-3530f47f0eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083741d3-4e65-4216-837b-39b9b2f3185b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG cinder.image.glance [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Creating Keystone auth plugin from conf {{(pid=86819) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 10:59:24 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5098f585-4a7c-426d-a721-054ab5ef08d7 1073741824" returned: 0 in 0.509s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5098f585-4a7c-426d-a721-054ab5ef08d7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:24 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5098f585-4a7c-426d-a721-054ab5ef08d7 Nov 06 10:59:24 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083741d3-4e65-4216-837b-39b9b2f3185b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '09ffeaae-b162-4da7-9a02-97bf40c995fc', 'volume_name': 'volume-09ffeaae-b162-4da7-9a02-97bf40c995fc', 'volume_size': 1, 'image_id': '5fec2226-d6f3-44e9-afa9-3cc8e99c502a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fec2226-d6f3-44e9-afa9-3cc8e99c502a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cb6e56cab8759ce16b106772484ed7a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6c31f2132add4f1db84eda3fd58f3f88', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7cfa4523f67dbf5124a3c57380a43034e63169c4fe3200547e3867f2c262ff75c3af3d4f14fd88dc5e8c831e525a3c446bd9cc5a2ce27b95787d10f692498b29', 'id': '5fec2226-d6f3-44e9-afa9-3cc8e99c502a', 'created_at': datetime.datetime(2026, 11, 6, 9, 59, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 59, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fec2226-d6f3-44e9-afa9-3cc8e99c502a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604e4e19-00b3-4dbe-b4bf-4f45104a9595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604e4e19-00b3-4dbe-b4bf-4f45104a9595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0044fed3-0655-4c95-bb82-3d8db1288c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:25 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Volume 09ffeaae-b162-4da7-9a02-97bf40c995fc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-09ffeaae-b162-4da7-9a02-97bf40c995fc', 'volume_size': 1, 'image_id': '5fec2226-d6f3-44e9-afa9-3cc8e99c502a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fec2226-d6f3-44e9-afa9-3cc8e99c502a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cb6e56cab8759ce16b106772484ed7a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6c31f2132add4f1db84eda3fd58f3f88', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7cfa4523f67dbf5124a3c57380a43034e63169c4fe3200547e3867f2c262ff75c3af3d4f14fd88dc5e8c831e525a3c446bd9cc5a2ce27b95787d10f692498b29', 'id': '5fec2226-d6f3-44e9-afa9-3cc8e99c502a', 'created_at': datetime.datetime(2026, 11, 6, 9, 59, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 59, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fec2226-d6f3-44e9-afa9-3cc8e99c502a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Trying to clone 09ffeaae-b162-4da7-9a02-97bf40c995fc from image 5fec2226-d6f3-44e9-afa9-3cc8e99c502a at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fec2226-d6f3-44e9-afa9-3cc8e99c502a', 'metadata': {}}]). {{(pid=86819) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 10:59:25 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5098f585-4a7c-426d-a721-054ab5ef08d7" returned: 0 in 0.256s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.417s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1023691248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8973c486-f133-45ea-98a5-e82872be4db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:22Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Creating volume 8973c486-f133-45ea-98a5-e82872be4db5 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:25 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 10:59:25 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Image download 0.00 MB at 0.00 MB/s Nov 06 10:59:25 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5 1073741824 Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16b78e2-eeea-4b58-a25d-d9223f8aadf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5098f585-4a7c-426d-a721-054ab5ef08d7', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:25 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d62136-3d6d-4710-8481-f945eae2b33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:25 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Volume volume-5098f585-4a7c-426d-a721-054ab5ef08d7 (5098f585-4a7c-426d-a721-054ab5ef08d7): created successfully Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d62136-3d6d-4710-8481-f945eae2b33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Flow 'volume_create_manager' (263da6dc-44c8-4a92-b8f8-7f1d2585e015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:25 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-0bb0bb0b-a147-4876-b764-0033b20f51ab tempest-CreateVolumesFromImageTest-1408972214 None] Created volume successfully. Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc5d9dd-f6fb-464e-b008-c003f17c2daf]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:25 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD Nov 06 10:59:25 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:25 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD" returned: 0 in 0.353s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:25 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5 1073741824" returned: 0 in 0.479s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:25 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5 Nov 06 10:59:25 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:25 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD Nov 06 10:59:25 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:25 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5" returned: 0 in 0.274s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.870s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1225393670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116c7ab4-e4b0-4ec8-bac0-afc541a3197b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61be6b8dfb024d2b8abf454b6ea8a97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:22Z,use_quota=True,user_id='cbbe1e95b4484a499dba9adeefc3b110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Creating volume 116c7ab4-e4b0-4ec8-bac0-afc541a3197b {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:25 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:26 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD" returned: 1 in 0.368s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Temporary image 5fec2226-d6f3-44e9-afa9-3cc8e99c502a is fetched for user 9acc98a5722a456ea863fcf3182674bd. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 10:59:26 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b 1073741824 Nov 06 10:59:26 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dffbe0-cf7d-48fc-bd6a-a85979b92632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8973c486-f133-45ea-98a5-e82872be4db5', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6cc263-e1e5-4df6-b891-5694fafbbf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:26 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Volume volume-8973c486-f133-45ea-98a5-e82872be4db5 (8973c486-f133-45ea-98a5-e82872be4db5): created successfully Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6cc263-e1e5-4df6-b891-5694fafbbf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (c114e4ee-2008-4640-b83b-086c62a5b2de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:26 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-bc13c929-a3d1-4409-83d7-d715c4b3f492 tempest-ProjectMemberTests-348771717 None] Created volume successfully. Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1098e51-68f7-48c2-a999-cc7a71837738]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:26 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD Nov 06 10:59:26 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:26 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b 1073741824" returned: 0 in 0.446s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:26 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD" returned: 0 in 0.348s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:26 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b Nov 06 10:59:26 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:26 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD Nov 06 10:59:26 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:26 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b" returned: 0 in 0.269s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7ee9e2-f835-4e06-88cc-cdd0ea4d5412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71a9bea-b215-4fc6-aa3a-b654c61ff69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] Creating offline snapshot 89b355bf-0725-4e5f-a56a-bcb0db605a3a of volume f189c2bd-804f-447e-ae1c-71a25c9feefd {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:59:26 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD" returned: 1 in 0.356s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:26 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Volume volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b (116c7ab4-e4b0-4ec8-bac0-afc541a3197b): created successfully Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71a9bea-b215-4fc6-aa3a-b654c61ff69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Flow 'volume_create_manager' (8a6df9bd-53b7-43f7-8a30-a51d141914e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3d1439-d7c9-4532-a963-42db4a03fdc1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:26 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-535ae132-0caa-408a-8912-23cc2f566365 tempest-CreateVolumesFromImageTest-1408972214 None] Created volume successfully. Nov 06 10:59:26 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd Nov 06 10:59:26 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:27 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd" returned: 0 in 0.422s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:27 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a 1G Nov 06 10:59:27 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "cinder-116c7ab4-e4b0-4ec8-bac0-afc541a3197b-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-116c7ab4-e4b0-4ec8-bac0-afc541a3197b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "cinder-quobyte-116c7ab4-e4b0-4ec8-bac0-afc541a3197b" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-quobyte-116c7ab4-e4b0-4ec8-bac0-afc541a3197b" acquired by "delete_volume" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:27 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c863dea8-82f4-4736-a13b-38acedca5f5f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:27 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a 1G" returned: 0 in 0.490s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f189c2bd-804f-447e-ae1c-71a25c9feefd -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:27 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b Nov 06 10:59:27 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:27 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f189c2bd-804f-447e-ae1c-71a25c9feefd -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a Nov 06 10:59:27 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:28 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b" returned: 0 in 0.384s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:28 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b Nov 06 10:59:28 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:28 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f189c2bd-804f-447e-ae1c-71a25c9feefd -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a" returned: 0 in 0.326s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:28 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a is being set with open permissions: ugo+rw Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:28 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a Nov 06 10:59:28 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:28 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-116c7ab4-e4b0-4ec8-bac0-afc541a3197b" returned: 0 in 0.248s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-quobyte-116c7ab4-e4b0-4ec8-bac0-afc541a3197b" released by "delete_volume" :: held 0.673s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:28 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a" returned: 0 in 0.266s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Created reservations ['505cbb1b-7ff1-4155-9499-4e60e00366a6', '869a4222-1cd7-472d-9135-27c64e5ac666', 'b12b0249-5e48-4c79-9dab-1aadcc41d28d', '49805e42-9a09-4545-b787-36431ff8e995'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:28 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.info Nov 06 10:59:28 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:28 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:28 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:28 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.info" returned: 0 in 0.293s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:28 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.info is being set with open permissions: ugo+rw Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:28 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.info Nov 06 10:59:28 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:28 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.280s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "cinder-5098f585-4a7c-426d-a721-054ab5ef08d7-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:28 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Deleted volume successfully. Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-5098f585-4a7c-426d-a721-054ab5ef08d7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e2c72c13-de40-43d5-a475-37252fe3a90d tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-116c7ab4-e4b0-4ec8-bac0-afc541a3197b-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "cinder-quobyte-5098f585-4a7c-426d-a721-054ab5ef08d7" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-quobyte-5098f585-4a7c-426d-a721-054ab5ef08d7" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[55985a6a-2b6d-4330-b882-9d4ad58dc689]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5098f585-4a7c-426d-a721-054ab5ef08d7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:28 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.info" returned: 0 in 0.300s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:28 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5098f585-4a7c-426d-a721-054ab5ef08d7 Nov 06 10:59:28 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.198s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ffeaae-b162-4da7-9a02-97bf40c995fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c31f2132add4f1db84eda3fd58f3f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:25Z,use_quota=True,user_id='9acc98a5722a456ea863fcf3182674bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38610ccd-20a4-4adf-b0ca-e7d2e5fddf45),volume_type_id=38610ccd-20a4-4adf-b0ca-e7d2e5fddf45)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Creating volume 09ffeaae-b162-4da7-9a02-97bf40c995fc {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:29 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:29 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc 1073741824 Nov 06 10:59:29 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:29 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d739e8a1-ac0c-49e1-9457-53ad8cc5e7e6 tempest-VolumeDependencyTests-410797868 None] Create snapshot completed successfully Nov 06 10:59:29 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5098f585-4a7c-426d-a721-054ab5ef08d7" returned: 0 in 0.397s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5098f585-4a7c-426d-a721-054ab5ef08d7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:29 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5098f585-4a7c-426d-a721-054ab5ef08d7 Nov 06 10:59:29 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:29 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc 1073741824" returned: 0 in 0.444s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:29 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc Nov 06 10:59:29 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:29 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5098f585-4a7c-426d-a721-054ab5ef08d7" returned: 0 in 0.289s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-quobyte-5098f585-4a7c-426d-a721-054ab5ef08d7" released by "delete_volume" :: held 0.743s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Created reservations ['23e385ec-4705-4e56-8b40-67c585f63ea1', 'c0c9fbae-efdf-428d-8b38-e1aa20a9b70f', '0718067b-34cf-4959-8299-8f664050bc19', '761149fb-0171-48ec-8a34-366dfd1e99fa'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:29 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:29 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:29 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc" returned: 0 in 0.242s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.524s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] Creating offline snapshot 69eedc73-9a79-4d70-a0ce-2762b6a99d01 of volume 8973c486-f133-45ea-98a5-e82872be4db5 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Attempting download of 5fec2226-d6f3-44e9-afa9-3cc8e99c502a ((None, [{'url': 'file:///opt/stack/data/glance/images/5fec2226-d6f3-44e9-afa9-3cc8e99c502a', 'metadata': {}}])) to volume 09ffeaae-b162-4da7-9a02-97bf40c995fc. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ce84b7-2845-45e1-8f8c-7c3b8ac32198]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a45709-b481-47ed-b845-8911a731f314]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_w3bjgrvn {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:29 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5 Nov 06 10:59:29 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:29 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_w3bjgrvn Nov 06 10:59:29 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "cinder-d1a4fd57-041f-4052-9df0-ea69c759a788-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:30 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.342s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-d1a4fd57-041f-4052-9df0-ea69c759a788-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Deleted volume successfully. Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-6c414f81-ce3b-454f-ba55-cc834241ec91 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-5098f585-4a7c-426d-a721-054ab5ef08d7-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "cinder-quobyte-d1a4fd57-041f-4052-9df0-ea69c759a788" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-quobyte-d1a4fd57-041f-4052-9df0-ea69c759a788" acquired by "delete_volume" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4564b394-bda7-497b-a976-78017b2b1f48]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1a4fd57-041f-4052-9df0-ea69c759a788 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:30 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5" returned: 0 in 0.475s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:30 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01 1G Nov 06 10:59:30 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:30 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1a4fd57-041f-4052-9df0-ea69c759a788 Nov 06 10:59:30 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:30 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_w3bjgrvn" returned: 0 in 0.513s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_w3bjgrvn {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:30 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_w3bjgrvn Nov 06 10:59:30 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:30 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1a4fd57-041f-4052-9df0-ea69c759a788" returned: 0 in 0.448s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1a4fd57-041f-4052-9df0-ea69c759a788 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:30 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1a4fd57-041f-4052-9df0-ea69c759a788 Nov 06 10:59:30 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:30 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_w3bjgrvn" returned: 1 in 0.436s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_w3bjgrvn' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb398d87-6941-44f5-84de-d849fe65ed59]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:30 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Flow 'volume_create_manager' (8247695c-d34d-4405-90fd-674da6ce974f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c39700e-5043-4bf7-ab27-874d3159d4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01 1G" returned: 0 in 0.591s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8973c486-f133-45ea-98a5-e82872be4db5 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c39700e-5043-4bf7-ab27-874d3159d4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-780856070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f4814b-57b6-4fa8-bf1c-fd2b75780ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='899e32af67854da58318817e63e17bbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=89b355bf-0725-4e5f-a56a-bcb0db605a3a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:31Z,use_quota=True,user_id='2c11c029581d41af9803e5aaa88abcfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6435f7-38b3-4850-a497-6840b6be44c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:30 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8973c486-f133-45ea-98a5-e82872be4db5 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01 Nov 06 10:59:30 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6435f7-38b3-4850-a497-6840b6be44c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5273bc8-516b-4c6d-a3ce-ad60b6445ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5273bc8-516b-4c6d-a3ce-ad60b6445ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '83f4814b-57b6-4fa8-bf1c-fd2b75780ec3', 'volume_name': 'volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3', 'volume_size': 1, 'snapshot_id': '89b355bf-0725-4e5f-a56a-bcb0db605a3a'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7573f7-883e-4318-aa18-a3c2a8046535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7573f7-883e-4318-aa18-a3c2a8046535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:30 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD Nov 06 10:59:30 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8172a81-b5d7-4036-9d39-032bf414e451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:30 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Volume 83f4814b-57b6-4fa8-bf1c-fd2b75780ec3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3', 'volume_size': 1, 'snapshot_id': '89b355bf-0725-4e5f-a56a-bcb0db605a3a'} Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:30 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1a4fd57-041f-4052-9df0-ea69c759a788" returned: 0 in 0.324s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-quobyte-d1a4fd57-041f-4052-9df0-ea69c759a788" released by "delete_volume" :: held 0.836s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Created reservations ['aa631308-cc8b-4642-9ff8-ce0903dc74c0', '6dfe9f5a-dca7-47d3-af15-32900d0bfd3a', '3acc0684-d628-4a1a-b935-cf3b77ef6c4a', 'e2f29172-b5e4-4bcd-883f-6a28fd0dd5e1'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:31 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:31 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:31 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:31 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8973c486-f133-45ea-98a5-e82872be4db5 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01" returned: 0 in 0.391s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:31 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01 is being set with open permissions: ugo+rw Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "cinder-65e1795d-c71f-46d2-bd12-7cc7bb252013-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:31 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01 Nov 06 10:59:31 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-65e1795d-c71f-46d2-bd12-7cc7bb252013-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:31 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD Nov 06 10:59:31 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "cinder-quobyte-65e1795d-c71f-46d2-bd12-7cc7bb252013" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-quobyte-65e1795d-c71f-46d2-bd12-7cc7bb252013" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b5fd7b-959e-4088-850f-cca2c615f7b7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-65e1795d-c71f-46d2-bd12-7cc7bb252013 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:31 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.327s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:31 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Deleted volume successfully. Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c2978572-5774-42a2-adca-09b013dc902f tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-d1a4fd57-041f-4052-9df0-ea69c759a788-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:31 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-65e1795d-c71f-46d2-bd12-7cc7bb252013 Nov 06 10:59:31 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:31 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01" returned: 0 in 0.332s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:31 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD" returned: 1 in 0.437s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] 5fec2226-d6f3-44e9-afa9-3cc8e99c502a was raw, converting to qcow2 {{(pid=86819) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:31 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.info Nov 06 10:59:31 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:31 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc Nov 06 10:59:31 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:31 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-65e1795d-c71f-46d2-bd12-7cc7bb252013" returned: 0 in 0.412s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-65e1795d-c71f-46d2-bd12-7cc7bb252013 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:31 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-65e1795d-c71f-46d2-bd12-7cc7bb252013 Nov 06 10:59:31 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:31 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.info" returned: 0 in 0.311s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:31 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.info is being set with open permissions: ugo+rw Nov 06 10:59:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:31 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.info Nov 06 10:59:31 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:32 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc" returned: 0 in 0.497s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fec2226-d6f3-44e9-afa9-3cc8e99c502a_su_4oup1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:59:32 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:32 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-65e1795d-c71f-46d2-bd12-7cc7bb252013" returned: 0 in 0.311s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:32 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc 1G Nov 06 10:59:32 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-quobyte-65e1795d-c71f-46d2-bd12-7cc7bb252013" released by "delete_volume" :: held 0.794s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:32 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.info" returned: 0 in 0.304s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.328s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Acquiring lock "cinder-quobyte-89b355bf-0725-4e5f-a56a-bcb0db605a3a-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3" by "_create_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Created reservations ['5be37327-1a49-4775-9646-831fd04ffb59', '6087904e-3032-4a73-8397-04e69afc4ab0', 'a1cee954-7e6f-44b7-a71a-b1315b7d525b', '5234dfac-a02a-468a-9f84-c0133d719179'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Lock "cinder-quobyte-89b355bf-0725-4e5f-a56a-bcb0db605a3a-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Creating volume 83f4814b-57b6-4fa8-bf1c-fd2b75780ec3 from snapshot 89b355bf-0725-4e5f-a56a-bcb0db605a3a {{(pid=86819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Acquiring lock "cinder-quobyte-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3" by "_copy_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:32 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2ec9e944-6e70-4aca-86a8-36d8bee9ed84 tempest-ProjectMemberTests-348771717 None] Create snapshot completed successfully Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Lock "cinder-quobyte-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] snapshot: 89b355bf-0725-4e5f-a56a-bcb0db605a3a, volume: 83f4814b-57b6-4fa8-bf1c-fd2b75780ec3, {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[518fdd91-68d6-490d-8c52-f33bce69453f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:32 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:32 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-69eedc73-9a79-4d70-a0ce-2762b6a99d01-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "cinder-c008d030-bdb4-46a4-ad8f-c34387d4ac46-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-c008d030-bdb4-46a4-ad8f-c34387d4ac46-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Lock "cinder-69eedc73-9a79-4d70-a0ce-2762b6a99d01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-8973c486-f133-45ea-98a5-e82872be4db5" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:32 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-8973c486-f133-45ea-98a5-e82872be4db5" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-69eedc73-9a79-4d70-a0ce-2762b6a99d01" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc 1G" returned: 0 in 0.497s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Downloaded image 5fec2226-d6f3-44e9-afa9-3cc8e99c502a ((None, [{'url': 'file:///opt/stack/data/glance/images/5fec2226-d6f3-44e9-afa9-3cc8e99c502a', 'metadata': {}}])) to volume 09ffeaae-b162-4da7-9a02-97bf40c995fc successfully. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Temporary image 5fec2226-d6f3-44e9-afa9-3cc8e99c502a for user 9acc98a5722a456ea863fcf3182674bd is deleted. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Marking volume 09ffeaae-b162-4da7-9a02-97bf40c995fc as bootable. {{(pid=86819) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "cinder-quobyte-c008d030-bdb4-46a4-ad8f-c34387d4ac46" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-69eedc73-9a79-4d70-a0ce-2762b6a99d01" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Deleting offline snapshot 69eedc73-9a79-4d70-a0ce-2762b6a99d01 of volume 8973c486-f133-45ea-98a5-e82872be4db5 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] snapshot_file for this snap is: volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:59:32 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a Nov 06 10:59:32 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Copying metadata from image 5fec2226-d6f3-44e9-afa9-3cc8e99c502a to 09ffeaae-b162-4da7-9a02-97bf40c995fc. {{(pid=86819) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Creating volume glance metadata for volume 09ffeaae-b162-4da7-9a02-97bf40c995fc backed by image 5fec2226-d6f3-44e9-afa9-3cc8e99c502a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5fec2226-d6f3-44e9-afa9-3cc8e99c502a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cb6e56cab8759ce16b106772484ed7a2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86819) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-quobyte-c008d030-bdb4-46a4-ad8f-c34387d4ac46" acquired by "delete_volume" :: waited 0.053s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aadc5d-1d5b-4bac-a379-ce9bc53ff22b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bdbb52-844b-483b-939d-858c11df5d50]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0044fed3-0655-4c95-bb82-3d8db1288c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ffeaae-b162-4da7-9a02-97bf40c995fc', 'volume_size': 1, 'image_id': '5fec2226-d6f3-44e9-afa9-3cc8e99c502a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fec2226-d6f3-44e9-afa9-3cc8e99c502a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cb6e56cab8759ce16b106772484ed7a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6c31f2132add4f1db84eda3fd58f3f88', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7cfa4523f67dbf5124a3c57380a43034e63169c4fe3200547e3867f2c262ff75c3af3d4f14fd88dc5e8c831e525a3c446bd9cc5a2ce27b95787d10f692498b29', 'id': '5fec2226-d6f3-44e9-afa9-3cc8e99c502a', 'created_at': datetime.datetime(2026, 11, 6, 9, 59, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 59, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fec2226-d6f3-44e9-afa9-3cc8e99c502a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c2d686-0f95-4b04-9123-01819d11f83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:32 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:32 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Volume volume-09ffeaae-b162-4da7-9a02-97bf40c995fc (09ffeaae-b162-4da7-9a02-97bf40c995fc): created successfully Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c2d686-0f95-4b04-9123-01819d11f83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Flow 'volume_create_manager' (18a78107-059a-404b-8999-d45a7e62e4c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.441s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:32 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01 Nov 06 10:59:32 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:32 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Deleted volume successfully. Nov 06 10:59:32 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d6aaeb3e-54bc-46de-b5ed-25ca28a4fc4b tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Created volume successfully. Nov 06 10:59:32 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46 Nov 06 10:59:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5730e8a1-e30e-4546-bbcb-d64cf5b7a010 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-65e1795d-c71f-46d2-bd12-7cc7bb252013-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:32 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:33 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a" returned: 0 in 0.592s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f189c2bd-804f-447e-ae1c-71a25c9feefd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd73b09-8954-4177-8d52-e0c8cfa505c4]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:33 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd Nov 06 10:59:33 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:33 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01" returned: 0 in 0.475s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8973c486-f133-45ea-98a5-e82872be4db5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:59:33 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46" returned: 0 in 0.492s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[88798ff9-825b-4ca1-a796-5c746d91dc0f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:33 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46 Nov 06 10:59:33 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Acquiring lock "cinder-09ffeaae-b162-4da7-9a02-97bf40c995fc-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Lock "cinder-09ffeaae-b162-4da7-9a02-97bf40c995fc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:33 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5 Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Acquiring lock "cinder-quobyte-09ffeaae-b162-4da7-9a02-97bf40c995fc" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:33 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Lock "cinder-quobyte-09ffeaae-b162-4da7-9a02-97bf40c995fc" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d514015a-a8b2-4dc2-98e0-4bc1301fbfb8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:33 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-c008d030-bdb4-46a4-ad8f-c34387d4ac46" returned: 0 in 0.307s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:33 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd" returned: 0 in 0.503s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] will copy from snapshot at /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Creating direct copy from snapshot {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG cinder.utils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Path /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3 not found in is_blk_device check {{(pid=86819) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-quobyte-c008d030-bdb4-46a4-ad8f-c34387d4ac46" released by "delete_volume" :: held 0.895s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:33 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3 Nov 06 10:59:33 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:33 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc Nov 06 10:59:33 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Created reservations ['27b5813a-6307-4baa-a65e-f2d55eb8eb5e', 'c907d1f5-14fc-43d1-85c1-8d0bd88e4225', '46309322-fefa-4d79-a4b9-06127b32949a', 'ffbc8c63-0c93-4a77-a946-44a5bbc78c43'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:33 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5" returned: 0 in 0.521s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:33 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:33 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:33 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01 Nov 06 10:59:33 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:33 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc" returned: 0 in 0.467s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:33 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc Nov 06 10:59:33 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:34 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.317s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:34 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:34 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Deleted volume successfully. Nov 06 10:59:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-831d9404-b654-4fc8-b9d4-7315d5faadb8 tempest-CreateVolumesFromImageTest-1408972214 None] Lock "cinder-c008d030-bdb4-46a4-ad8f-c34387d4ac46-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:34 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01" returned: 0 in 0.474s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:34 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-09ffeaae-b162-4da7-9a02-97bf40c995fc" returned: 0 in 0.321s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Lock "cinder-quobyte-09ffeaae-b162-4da7-9a02-97bf40c995fc" released by "delete_volume" :: held 0.860s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:34 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01 Nov 06 10:59:34 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:34 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Created reservations ['59fea70f-e828-40fd-b405-9cdd9cb270c5', '618f00da-ff80-4a24-adfb-0e48ffaf6eed', 'a6d49a17-569b-4d71-842a-46eb03a15e1d', 'd213ebdf-3f08-4a17-b9e2-b8ba615dcae7'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:34 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:34 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:34 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5.69eedc73-9a79-4d70-a0ce-2762b6a99d01" returned: 0 in 0.753s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-69eedc73-9a79-4d70-a0ce-2762b6a99d01" released by "_delete_snapshot" :: held 2.475s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-8973c486-f133-45ea-98a5-e82872be4db5" released by "delete_snapshot" :: held 2.514s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:35 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Created reservations ['4fe2d342-8ff9-45f8-91cf-e001057008b7', '1d96b53c-6c6b-4c90-b419-3a7e9c7f5a7c', '94864363-c83e-4674-b96a-e2366b4c0634', '658ef944-32c2-4665-b4fb-dc7cd1ade2cc'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:35 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Delete snapshot completed successfully. Nov 06 10:59:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c161a3b3-b3ae-4b64-8cbb-fa911a08935b tempest-ProjectMemberTests-348771717 None] Lock "cinder-69eedc73-9a79-4d70-a0ce-2762b6a99d01-delete_snapshot" released by "delete_snapshot" :: held 2.817s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:35 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 1.172s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:35 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:35 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Deleted volume successfully. Nov 06 10:59:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-f973783f-8459-4ebf-9818-9896f2731242 tempest-VolumeAndVolumeTypeFromImageTest-420660286 None] Lock "cinder-09ffeaae-b162-4da7-9a02-97bf40c995fc-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-8973c486-f133-45ea-98a5-e82872be4db5-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Lock "cinder-8973c486-f133-45ea-98a5-e82872be4db5-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-8973c486-f133-45ea-98a5-e82872be4db5" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:36 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:36 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-8973c486-f133-45ea-98a5-e82872be4db5" acquired by "delete_volume" :: waited 0.041s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc74e26a-7f1c-4c41-af09-58d3dfce315f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:36 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.433s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 29 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 10:59:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 10:59:36 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5 Nov 06 10:59:36 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:37 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5" returned: 0 in 0.920s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:37 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5 Nov 06 10:59:37 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:37 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8973c486-f133-45ea-98a5-e82872be4db5" returned: 0 in 0.559s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-8973c486-f133-45ea-98a5-e82872be4db5" released by "delete_volume" :: held 1.687s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:38 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Created reservations ['353df4ee-1f60-4044-9612-bfc52bad1850', 'e71adf35-9e7e-4208-a9a4-c134d285ed61', '2202bec6-336b-4050-adb8-08edfb733e68', '46a4869f-f29b-4ea0-82e0-71f85f7ed85a'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:38 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:38 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:38 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.770s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:38 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:39 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Deleted volume successfully. Nov 06 10:59:39 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-bdd31f29-651a-4f8a-85eb-dfe0c470691c tempest-ProjectMemberTests-348771717 None] Lock "cinder-8973c486-f133-45ea-98a5-e82872be4db5-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:39 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (98cc043f-50fc-4bcd-bd65-26a496b167ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7cdb0b1-950c-42f7-8cd7-b368246aed59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7cdb0b1-950c-42f7-8cd7-b368246aed59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-473740003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312a09af-5f42-46a4-82fa-ccfa7a339a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:39Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909e644a-6727-4d9c-9ac3-1cf7d2a22ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909e644a-6727-4d9c-9ac3-1cf7d2a22ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa632d49-c343-4b90-b3f8-beacae4b6283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa632d49-c343-4b90-b3f8-beacae4b6283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '312a09af-5f42-46a4-82fa-ccfa7a339a0e', 'volume_name': 'volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0328552d-e56c-4083-87e6-4928adfed134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0328552d-e56c-4083-87e6-4928adfed134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:39 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3b72d1-d9f3-42e2-b17b-881aae916718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:39 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Volume 312a09af-5f42-46a4-82fa-ccfa7a339a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e', 'volume_size': 1} Nov 06 10:59:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:42 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Flow 'volume_create_manager' (d99519d6-71f1-4f0c-a58e-2e3f09342cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ca72d9-cfff-443f-a68b-2246dd2229e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ca72d9-cfff-443f-a68b-2246dd2229e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2bd6f2-f616-43e1-831b-4f4ac5048613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1fd2eaeb7b48779ea7c5402e4eae97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:43Z,use_quota=True,user_id='fb5d44a7013c4eb48e938ee3f817cce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c77591-8a5e-49e5-8888-b373336cbeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c77591-8a5e-49e5-8888-b373336cbeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d489fee-235c-453e-b911-eefe5a29655c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d489fee-235c-453e-b911-eefe5a29655c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec2bd6f2-f616-43e1-831b-4f4ac5048613', 'volume_name': 'volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6cc9863-eb1d-4c52-a868-d8d6897adcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6cc9863-eb1d-4c52-a868-d8d6897adcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:42 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2100743-b5a4-45e2-838d-75e9d61f2c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:42 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Volume ec2bd6f2-f616-43e1-831b-4f4ac5048613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613', 'volume_size': 1} Nov 06 10:59:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:43 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3" returned: 0 in 9.576s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Image conversion details: src /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd, size 1024.00 MB, duration 9.58 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3 {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 10:59:43 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Converted 1024.00 MB image at 106.93 MB/s Nov 06 10:59:43 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3 is being set with open permissions: ugo+rw Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:43 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3 Nov 06 10:59:43 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:43 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3" returned: 0 in 0.245s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Lock "cinder-quobyte-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3" released by "_copy_volume_from_snapshot" :: held 11.080s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Lock "cinder-quobyte-89b355bf-0725-4e5f-a56a-bcb0db605a3a-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3" released by "_create_volume_from_snapshot" :: held 11.156s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.200s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.699s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-473740003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312a09af-5f42-46a4-82fa-ccfa7a339a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:39Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Creating volume 312a09af-5f42-46a4-82fa-ccfa7a339a0e {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:43 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:43 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e 1073741824 Nov 06 10:59:43 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8172a81-b5d7-4036-9d39-032bf414e451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3', 'volume_size': 1, 'snapshot_id': '89b355bf-0725-4e5f-a56a-bcb0db605a3a'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e856f582-1c52-4853-9b9f-da3f152bf18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:43 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Volume volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3 (83f4814b-57b6-4fa8-bf1c-fd2b75780ec3): created successfully Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e856f582-1c52-4853-9b9f-da3f152bf18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Flow 'volume_create_manager' (8247695c-d34d-4405-90fd-674da6ce974f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:43 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-293ab77a-a8d5-41dd-8d35-2ae756a29f9e tempest-VolumeDependencyTests-410797868 None] Created volume successfully. Nov 06 10:59:43 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e 1073741824" returned: 0 in 0.479s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:44 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e Nov 06 10:59:44 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Acquiring lock "cinder-89b355bf-0725-4e5f-a56a-bcb0db605a3a-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Lock "cinder-89b355bf-0725-4e5f-a56a-bcb0db605a3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Acquiring lock "cinder-quobyte-f189c2bd-804f-447e-ae1c-71a25c9feefd" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Lock "cinder-quobyte-f189c2bd-804f-447e-ae1c-71a25c9feefd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Acquiring lock "cinder-quobyte-89b355bf-0725-4e5f-a56a-bcb0db605a3a" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Lock "cinder-quobyte-89b355bf-0725-4e5f-a56a-bcb0db605a3a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Deleting offline snapshot 89b355bf-0725-4e5f-a56a-bcb0db605a3a of volume f189c2bd-804f-447e-ae1c-71a25c9feefd {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] snapshot_file for this snap is: volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:59:44 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7915b943-ef61-469a-bca9-5e328020f61a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e" returned: 0 in 0.327s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2bd6f2-f616-43e1-831b-4f4ac5048613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1fd2eaeb7b48779ea7c5402e4eae97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:43Z,use_quota=True,user_id='fb5d44a7013c4eb48e938ee3f817cce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Creating volume ec2bd6f2-f616-43e1-831b-4f4ac5048613 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:44 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3b72d1-d9f3-42e2-b17b-881aae916718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:44 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613 1073741824 Nov 06 10:59:44 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da83065-5b81-43e5-9848-992b2f24842b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:44 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Volume volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e (312a09af-5f42-46a4-82fa-ccfa7a339a0e): created successfully Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da83065-5b81-43e5-9848-992b2f24842b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (98cc043f-50fc-4bcd-bd65-26a496b167ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:44 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9f018df7-c672-439c-9654-fce3e631f432 tempest-ProjectMemberTests-348771717 None] Created volume successfully. Nov 06 10:59:44 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a Nov 06 10:59:44 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Flow 'volume_create_manager' (dfc1a918-5c69-4b60-be7b-41d9088c3b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5d356f-4134-442e-a1b7-7c3effbf9d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5d356f-4134-442e-a1b7-7c3effbf9d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1534399513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87b1fd1-9ac6-4d77-9ad4-89f423d95299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918a3e3271794663b48088d3d0181234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:44Z,use_quota=True,user_id='1c310a12751c4ae5aa85db3bdcc37eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64242605-7480-49b0-94d9-06eb4b943112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64242605-7480-49b0-94d9-06eb4b943112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66c3de0-c40c-4789-a199-6cce48b1be56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66c3de0-c40c-4789-a199-6cce48b1be56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f87b1fd1-9ac6-4d77-9ad4-89f423d95299', 'volume_name': 'volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e06c4c-1574-49dd-8ecc-742db5d5c3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e06c4c-1574-49dd-8ecc-742db5d5c3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94e823d-80c9-4dde-a8e0-835a93f0e353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:44 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume f87b1fd1-9ac6-4d77-9ad4-89f423d95299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299', 'volume_size': 1} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:44 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a" returned: 0 in 0.405s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f189c2bd-804f-447e-ae1c-71a25c9feefd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb10d4b-f683-4fd9-b38f-6e1d77e6ec43]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:44 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613 1073741824" returned: 0 in 0.490s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:44 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd Nov 06 10:59:44 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:44 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613 Nov 06 10:59:44 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:45 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613" returned: 0 in 0.268s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1534399513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87b1fd1-9ac6-4d77-9ad4-89f423d95299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918a3e3271794663b48088d3d0181234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:44Z,use_quota=True,user_id='1c310a12751c4ae5aa85db3bdcc37eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Creating volume f87b1fd1-9ac6-4d77-9ad4-89f423d95299 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:45 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2100743-b5a4-45e2-838d-75e9d61f2c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8cbff25-fea1-45b6-a4ab-3fe9f8b60480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:45 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 1073741824 Nov 06 10:59:45 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:45 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Volume volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613 (ec2bd6f2-f616-43e1-831b-4f4ac5048613): created successfully Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8cbff25-fea1-45b6-a4ab-3fe9f8b60480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Flow 'volume_create_manager' (d99519d6-71f1-4f0c-a58e-2e3f09342cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:45 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-59654092-2ddb-47fd-9abe-df22002760d7 tempest-CinderUnicodeTest-453913821 None] Created volume successfully. Nov 06 10:59:45 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd" returned: 0 in 0.570s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:45 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a Nov 06 10:59:45 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:45 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 1073741824" returned: 0 in 0.495s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:45 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a" returned: 0 in 0.390s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:45 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 Nov 06 10:59:45 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:45 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a Nov 06 10:59:45 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:45 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299" returned: 0 in 0.270s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.566s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94e823d-80c9-4dde-a8e0-835a93f0e353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:45 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc3642c-3732-4f0d-9615-b3613e5a040b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:45 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd.89b355bf-0725-4e5f-a56a-bcb0db605a3a" returned: 0 in 0.289s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] Creating offline snapshot db67d588-c231-4981-8442-21c78e5e8b43 of volume 312a09af-5f42-46a4-82fa-ccfa7a339a0e {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:59:46 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 (f87b1fd1-9ac6-4d77-9ad4-89f423d95299): created successfully Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc3642c-3732-4f0d-9615-b3613e5a040b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Flow 'volume_create_manager' (dfc1a918-5c69-4b60-be7b-41d9088c3b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4e0284-768e-49d3-a9d3-f063bd709c2c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Lock "cinder-quobyte-89b355bf-0725-4e5f-a56a-bcb0db605a3a" released by "_delete_snapshot" :: held 1.844s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:46 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d7744557-28d8-4c82-9d9f-2ca70612c1c7 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Created volume successfully. Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Lock "cinder-quobyte-f189c2bd-804f-447e-ae1c-71a25c9feefd" released by "delete_snapshot" :: held 1.876s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:46 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e Nov 06 10:59:46 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Created reservations ['fc018c57-5afa-45f6-92da-8c1ff0192300', 'b4fb7b57-9aa3-4311-a009-dc33e47ae308', '5f9bab30-4ba2-4adf-a53f-39f6842cce7d', '8c8f547c-eb40-4ad4-9675-fca54c26ad4f'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:46 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Delete snapshot completed successfully. Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d2e04fa8-d8ec-4686-9cfe-76b2a9355e0f tempest-VolumeDependencyTests-410797868 None] Lock "cinder-89b355bf-0725-4e5f-a56a-bcb0db605a3a-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Flow 'volume_create_manager' (7969ee9a-a352-4c20-b770-211c4a9cadc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82a5dfc-6272-434f-a25c-1f70e9caca15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82a5dfc-6272-434f-a25c-1f70e9caca15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2021126064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62787b56-dd07-4d25-99bd-9de20f12f64f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1fd2eaeb7b48779ea7c5402e4eae97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:46Z,use_quota=True,user_id='fb5d44a7013c4eb48e938ee3f817cce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ef2e65-4411-444a-9dd4-a69253a588f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ef2e65-4411-444a-9dd4-a69253a588f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22bf1c0-9c97-4b08-a952-51f268649df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22bf1c0-9c97-4b08-a952-51f268649df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62787b56-dd07-4d25-99bd-9de20f12f64f', 'volume_name': 'volume-62787b56-dd07-4d25-99bd-9de20f12f64f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7f5821-192c-4bf2-b2b8-c2db25a0b31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7f5821-192c-4bf2-b2b8-c2db25a0b31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ed0d8f-c932-4d6b-b6a9-9e8d4ef4320b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:46 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Volume 62787b56-dd07-4d25-99bd-9de20f12f64f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62787b56-dd07-4d25-99bd-9de20f12f64f', 'volume_size': 1} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Acquiring lock "cinder-f189c2bd-804f-447e-ae1c-71a25c9feefd-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Lock "cinder-f189c2bd-804f-447e-ae1c-71a25c9feefd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Acquiring lock "cinder-quobyte-f189c2bd-804f-447e-ae1c-71a25c9feefd" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Lock "cinder-quobyte-f189c2bd-804f-447e-ae1c-71a25c9feefd" acquired by "delete_volume" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f9b8ef-7eb3-4c5c-a1ca-a633bc91f2bf]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:46 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e" returned: 0 in 0.503s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:46 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43 1G Nov 06 10:59:46 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:46 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd Nov 06 10:59:46 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:46 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd" returned: 0 in 0.400s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:46 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd Nov 06 10:59:46 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:47 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43 1G" returned: 0 in 0.476s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:47 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43 Nov 06 10:59:47 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:47 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f189c2bd-804f-447e-ae1c-71a25c9feefd" returned: 0 in 0.250s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Lock "cinder-quobyte-f189c2bd-804f-447e-ae1c-71a25c9feefd" released by "delete_volume" :: held 0.725s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Created reservations ['dd7216da-8699-420e-9f8a-564ab764e5d7', '82c526ff-e4d3-4a5c-ba6d-62461877cfea', 'cc73d2bb-20aa-48b7-96c3-f9e22bc9732e', '16e4496c-8361-4032-8b74-116487cedfeb'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:47 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43" returned: 0 in 0.324s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:47 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43 is being set with open permissions: ugo+rw Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:47 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:47 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:47 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43 Nov 06 10:59:47 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:47 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.275s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:47 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Deleted volume successfully. Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Acquiring lock "cinder-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:47 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Lock "cinder-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43" returned: 0 in 0.312s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-953bd738-945c-4fd1-a3c9-3ecbd8ac12bc tempest-VolumeDependencyTests-410797868 None] Lock "cinder-f189c2bd-804f-447e-ae1c-71a25c9feefd-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Acquiring lock "cinder-quobyte-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:47 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.info Nov 06 10:59:47 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Lock "cinder-quobyte-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5ba175-4bf5-40b4-8a43-585c4a041c77]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:47 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3 Nov 06 10:59:47 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:47 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.info" returned: 0 in 0.280s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:47 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.info is being set with open permissions: ugo+rw Nov 06 10:59:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:48 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.info Nov 06 10:59:48 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:48 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3" returned: 0 in 0.380s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:48 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3 Nov 06 10:59:48 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:48 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.info" returned: 0 in 0.258s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.283s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.872s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2021126064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62787b56-dd07-4d25-99bd-9de20f12f64f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1fd2eaeb7b48779ea7c5402e4eae97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:46Z,use_quota=True,user_id='fb5d44a7013c4eb48e938ee3f817cce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Creating volume 62787b56-dd07-4d25-99bd-9de20f12f64f {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:48 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:48 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f 1073741824 Nov 06 10:59:48 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:48 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-36414d03-7743-445d-a516-65bd7fa94dde tempest-ProjectMemberTests-348771717 None] Create snapshot completed successfully Nov 06 10:59:48 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3" returned: 0 in 0.274s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Lock "cinder-quobyte-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3" released by "delete_volume" :: held 0.705s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Created reservations ['255223ff-a0ea-4a8a-9ecc-217278492894', 'ecc95a55-6d1c-40d8-80cd-9caa918a408c', 'f2e2726c-a6a1-4334-9e30-3c2dd487e568', 'd3b70e0b-ebac-41c7-ba26-2231defdeb10'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-db67d588-c231-4981-8442-21c78e5e8b43-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:48 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:48 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Lock "cinder-db67d588-c231-4981-8442-21c78e5e8b43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-312a09af-5f42-46a4-82fa-ccfa7a339a0e" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-312a09af-5f42-46a4-82fa-ccfa7a339a0e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-db67d588-c231-4981-8442-21c78e5e8b43" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-db67d588-c231-4981-8442-21c78e5e8b43" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Deleting offline snapshot db67d588-c231-4981-8442-21c78e5e8b43 of volume 312a09af-5f42-46a4-82fa-ccfa7a339a0e {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] snapshot_file for this snap is: volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b050b3-2621-45bf-aed3-3df40f062414]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:48 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f 1073741824" returned: 0 in 0.562s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:48 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43 Nov 06 10:59:48 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:48 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.308s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:48 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Deleted volume successfully. Nov 06 10:59:48 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f Nov 06 10:59:48 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:48 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-fd6f05bc-06d4-4e78-87b5-d2a9e53adf8c tempest-VolumeDependencyTests-410797868 None] Lock "cinder-83f4814b-57b6-4fa8-bf1c-fd2b75780ec3-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:49 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43" returned: 0 in 0.412s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:59:49 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f" returned: 0 in 0.272s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.370s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[88998a7f-fd53-4813-aaf8-11a4a2409c51]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Creating offline snapshot a360e10c-86f6-4276-b40e-bd31774d81ed of volume f87b1fd1-9ac6-4d77-9ad4-89f423d95299 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ed0d8f-c932-4d6b-b6a9-9e8d4ef4320b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62787b56-dd07-4d25-99bd-9de20f12f64f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d69dcf-8e36-4259-a52d-a3efb950a416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee502e1c-a677-499d-8a67-b2c052ba80be]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:49 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Volume volume-62787b56-dd07-4d25-99bd-9de20f12f64f (62787b56-dd07-4d25-99bd-9de20f12f64f): created successfully Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d69dcf-8e36-4259-a52d-a3efb950a416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Flow 'volume_create_manager' (7969ee9a-a352-4c20-b770-211c4a9cadc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:49 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-131f21af-dad2-4547-bc56-d620d138f2ab tempest-CinderUnicodeTest-453913821 None] Created volume successfully. Nov 06 10:59:49 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e Nov 06 10:59:49 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:49 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 Nov 06 10:59:49 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:49 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e" returned: 0 in 0.468s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:49 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43 Nov 06 10:59:49 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:49 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299" returned: 0 in 0.472s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:49 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed 1G Nov 06 10:59:49 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:50 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43" returned: 0 in 0.460s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:50 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43 Nov 06 10:59:50 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:50 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed 1G" returned: 0 in 0.520s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:50 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed Nov 06 10:59:50 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:50 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e.db67d588-c231-4981-8442-21c78e5e8b43" returned: 0 in 0.286s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-db67d588-c231-4981-8442-21c78e5e8b43" released by "_delete_snapshot" :: held 1.763s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-312a09af-5f42-46a4-82fa-ccfa7a339a0e" released by "delete_snapshot" :: held 1.790s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Created reservations ['a2fccad6-9e89-4fcb-a9ef-91f030571bb2', 'cd88a6de-b632-45fe-bbd2-44e5820019fe', '4ae12dfd-dd06-4649-87de-c50cc6248af0', 'd472f64e-711d-4dec-918e-f744f661f0ed'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:50 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed" returned: 0 in 0.334s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:50 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed is being set with open permissions: ugo+rw Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:50 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed Nov 06 10:59:50 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:50 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Delete snapshot completed successfully. Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-817f9539-7aa5-4ee8-8c0f-822e212f1028 tempest-ProjectMemberTests-348771717 None] Lock "cinder-db67d588-c231-4981-8442-21c78e5e8b43-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-312a09af-5f42-46a4-82fa-ccfa7a339a0e-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:50 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Lock "cinder-312a09af-5f42-46a4-82fa-ccfa7a339a0e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed" returned: 0 in 0.293s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:50 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.info Nov 06 10:59:50 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-312a09af-5f42-46a4-82fa-ccfa7a339a0e" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-312a09af-5f42-46a4-82fa-ccfa7a339a0e" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a3474a-fcf8-4e04-a26f-3dd55231ea7b]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:51 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e Nov 06 10:59:51 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:51 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.info" returned: 0 in 0.291s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:51 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.info is being set with open permissions: ugo+rw Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:51 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.info Nov 06 10:59:51 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:51 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e" returned: 0 in 0.390s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:51 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e Nov 06 10:59:51 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:51 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.info" returned: 0 in 0.279s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.659s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] Creating offline snapshot 684d7c53-43ef-4944-9d8a-fa61144c36f2 of volume 62787b56-dd07-4d25-99bd-9de20f12f64f {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:59:51 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-772eb285-0727-458a-bb0f-c5319234f648 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Create snapshot completed successfully Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[294e29ad-c260-473d-99db-34c6dc0110f7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:51 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-312a09af-5f42-46a4-82fa-ccfa7a339a0e" returned: 0 in 0.284s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:51 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f Nov 06 10:59:51 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-312a09af-5f42-46a4-82fa-ccfa7a339a0e" released by "delete_volume" :: held 0.742s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Created reservations ['521807e9-9c28-4e41-9b7d-cf2915c81d26', 'efe2fa5b-8d64-4c20-ba5b-15e286612413', '1097d1b6-974f-4875-863a-f0f6eff88e1f', '0100f6ba-4481-4453-b2a6-3c11a3159712'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:51 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:51 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:52 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f" returned: 0 in 0.456s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:52 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2 1G Nov 06 10:59:52 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:52 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.345s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:52 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:52 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Deleted volume successfully. Nov 06 10:59:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-98247247-08fa-47cb-8e85-3e0f0ef7fdee tempest-ProjectMemberTests-348771717 None] Lock "cinder-312a09af-5f42-46a4-82fa-ccfa7a339a0e-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:52 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2 1G" returned: 0 in 0.556s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62787b56-dd07-4d25-99bd-9de20f12f64f -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:52 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62787b56-dd07-4d25-99bd-9de20f12f64f -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2 Nov 06 10:59:52 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:52 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (26404830-3bd9-4a7a-a0e0-ec81e08280ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fbf96a-53b6-4659-92cc-7042032fb5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62787b56-dd07-4d25-99bd-9de20f12f64f -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2" returned: 0 in 0.433s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:53 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2 is being set with open permissions: ugo+rw Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fbf96a-53b6-4659-92cc-7042032fb5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-782601276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7186a02-631a-4807-bea0-4cfb1d5765da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:53Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2 Nov 06 10:59:53 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ca0f01-e2cb-4a66-bc4e-460fce6159ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ca0f01-e2cb-4a66-bc4e-460fce6159ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23f81fb-61ad-4d61-9834-4d15706edeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23f81fb-61ad-4d61-9834-4d15706edeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7186a02-631a-4807-bea0-4cfb1d5765da', 'volume_name': 'volume-f7186a02-631a-4807-bea0-4cfb1d5765da', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0132d8ee-5b36-4fbc-a44e-276b297b16d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0132d8ee-5b36-4fbc-a44e-276b297b16d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce12222-6e50-49d2-ac63-8a5b5dcfd7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Volume f7186a02-631a-4807-bea0-4cfb1d5765da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7186a02-631a-4807-bea0-4cfb1d5765da', 'volume_size': 1} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Flow 'volume_create_manager' (c19167f8-dfa7-4317-a31e-233fdb12df4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6350164-7d3a-4ec0-9524-bcc63ece8e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6350164-7d3a-4ec0-9524-bcc63ece8e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-662859312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a1e5d6-646d-4def-b99c-c952ae61747b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918a3e3271794663b48088d3d0181234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:53Z,use_quota=True,user_id='1c310a12751c4ae5aa85db3bdcc37eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60b6da9-17ac-45b3-b029-7413584fe535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60b6da9-17ac-45b3-b029-7413584fe535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be0e109-3c87-4594-9e79-ef51e6bd7760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be0e109-3c87-4594-9e79-ef51e6bd7760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a1e5d6-646d-4def-b99c-c952ae61747b', 'volume_name': 'volume-b7a1e5d6-646d-4def-b99c-c952ae61747b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167fee85-2352-4087-bf75-ab0f975c269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167fee85-2352-4087-bf75-ab0f975c269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d4caee-eb49-496c-8a2f-604c7616daba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume b7a1e5d6-646d-4def-b99c-c952ae61747b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a1e5d6-646d-4def-b99c-c952ae61747b', 'volume_size': 1} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Flow 'volume_create_manager' (72eea8b3-00f8-4162-839f-37f76e537573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68834b6f-2ac8-4a70-aa0e-e852653988ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2" returned: 0 in 0.286s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68834b6f-2ac8-4a70-aa0e-e852653988ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1243519894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0a74bd-2102-418a-b434-a7e85b10474b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918a3e3271794663b48088d3d0181234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:53Z,use_quota=True,user_id='1c310a12751c4ae5aa85db3bdcc37eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf7cae6-b4a8-40f4-9384-55e2ca196366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf7cae6-b4a8-40f4-9384-55e2ca196366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df16dbd-aaeb-445c-8292-10d9da1462cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df16dbd-aaeb-445c-8292-10d9da1462cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b0a74bd-2102-418a-b434-a7e85b10474b', 'volume_name': 'volume-5b0a74bd-2102-418a-b434-a7e85b10474b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90dd6bd3-b425-47cb-bc31-4d900c899d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90dd6bd3-b425-47cb-bc31-4d900c899d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bef7815-133b-4586-af30-c99800399501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume 5b0a74bd-2102-418a-b434-a7e85b10474b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b0a74bd-2102-418a-b434-a7e85b10474b', 'volume_size': 1} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:53 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.info Nov 06 10:59:53 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Flow 'volume_create_manager' (a54daa65-6707-4e52-8556-3370ed390033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aefd146-4a12-4143-9d2e-fa5f225020a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aefd146-4a12-4143-9d2e-fa5f225020a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-40508134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1375ad38-69d4-4ca0-824c-b3632710ab37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918a3e3271794663b48088d3d0181234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:54Z,use_quota=True,user_id='1c310a12751c4ae5aa85db3bdcc37eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f309aea4-08e1-4088-a720-042dc8ab5ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f309aea4-08e1-4088-a720-042dc8ab5ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e3b1b5-9ac8-4134-9552-789ca9e16939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e3b1b5-9ac8-4134-9552-789ca9e16939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1375ad38-69d4-4ca0-824c-b3632710ab37', 'volume_name': 'volume-1375ad38-69d4-4ca0-824c-b3632710ab37', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbb9755-1ab6-4ff1-9ece-6bf28eb946f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbb9755-1ab6-4ff1-9ece-6bf28eb946f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71de1db0-da25-4686-a9fa-148c40a97a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:53 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume 1375ad38-69d4-4ca0-824c-b3632710ab37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1375ad38-69d4-4ca0-824c-b3632710ab37', 'volume_size': 1} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.info" returned: 0 in 0.442s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:53 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.info is being set with open permissions: ugo+rw Nov 06 10:59:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:53 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.info Nov 06 10:59:53 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Flow 'volume_create_manager' (b66667b3-e1b1-486d-9af1-bc67826a4ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4c3dd1-e5f0-48cb-832a-2c6e98a3a2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4c3dd1-e5f0-48cb-832a-2c6e98a3a2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145860368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b701f87-9946-4f8a-b5bb-71573757d308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918a3e3271794663b48088d3d0181234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:54Z,use_quota=True,user_id='1c310a12751c4ae5aa85db3bdcc37eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f852259b-c3d4-4cdc-a1d0-0000f57dff0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f852259b-c3d4-4cdc-a1d0-0000f57dff0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6125b3-0c48-4308-b062-cabe4cf3bb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6125b3-0c48-4308-b062-cabe4cf3bb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b701f87-9946-4f8a-b5bb-71573757d308', 'volume_name': 'volume-2b701f87-9946-4f8a-b5bb-71573757d308', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b17dff0-23b9-4e2a-912d-28129181b644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b17dff0-23b9-4e2a-912d-28129181b644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd36185-5e1f-446c-9923-1219fd163b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:54 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume 2b701f87-9946-4f8a-b5bb-71573757d308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b701f87-9946-4f8a-b5bb-71573757d308', 'volume_size': 1} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:54 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.info" returned: 0 in 0.339s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.681s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.083s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-782601276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7186a02-631a-4807-bea0-4cfb1d5765da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:53Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Creating volume f7186a02-631a-4807-bea0-4cfb1d5765da {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:54 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:54 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da 1073741824 Nov 06 10:59:54 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:54 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5e4a78cc-8897-498a-98cf-19be11ccb962 tempest-CinderUnicodeTest-453913821 None] Create snapshot completed successfully Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Flow 'volume_create_manager' (1d7380f5-750c-4bac-aeeb-f85746afa7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4385306a-a018-42a8-86d8-ae0159099e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4385306a-a018-42a8-86d8-ae0159099e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-43778382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918a3e3271794663b48088d3d0181234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:54Z,use_quota=True,user_id='1c310a12751c4ae5aa85db3bdcc37eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283b26eb-36dd-44eb-a739-802a79f75165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283b26eb-36dd-44eb-a739-802a79f75165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed24c79-e1c3-4a4d-bd9e-0a03fa70324e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed24c79-e1c3-4a4d-bd9e-0a03fa70324e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d', 'volume_name': 'volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86681317-f3a9-4cb2-90c4-a02546d72ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86681317-f3a9-4cb2-90c4-a02546d72ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25d558c-cde4-487a-b696-9f3932ae5b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:54 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume 47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d', 'volume_size': 1} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:54 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da 1073741824" returned: 0 in 0.555s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:54 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da Nov 06 10:59:54 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:55 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da" returned: 0 in 0.248s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.810s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-662859312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a1e5d6-646d-4def-b99c-c952ae61747b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918a3e3271794663b48088d3d0181234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:53Z,use_quota=True,user_id='1c310a12751c4ae5aa85db3bdcc37eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Creating volume b7a1e5d6-646d-4def-b99c-c952ae61747b {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:55 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b7a1e5d6-646d-4def-b99c-c952ae61747b 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce12222-6e50-49d2-ac63-8a5b5dcfd7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7186a02-631a-4807-bea0-4cfb1d5765da', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:55 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b7a1e5d6-646d-4def-b99c-c952ae61747b 1073741824 Nov 06 10:59:55 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11603ee6-5ba3-4bac-8fc5-1bb717d148d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:55 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Volume volume-f7186a02-631a-4807-bea0-4cfb1d5765da (f7186a02-631a-4807-bea0-4cfb1d5765da): created successfully Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11603ee6-5ba3-4bac-8fc5-1bb717d148d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (26404830-3bd9-4a7a-a0e0-ec81e08280ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Acquiring lock "cinder-684d7c53-43ef-4944-9d8a-fa61144c36f2-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Lock "cinder-684d7c53-43ef-4944-9d8a-fa61144c36f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Acquiring lock "cinder-quobyte-62787b56-dd07-4d25-99bd-9de20f12f64f" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:55 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-73c5a6b1-5c77-45e1-9c36-50e8c404028b tempest-ProjectMemberTests-348771717 None] Created volume successfully. Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Lock "cinder-quobyte-62787b56-dd07-4d25-99bd-9de20f12f64f" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Acquiring lock "cinder-quobyte-684d7c53-43ef-4944-9d8a-fa61144c36f2" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Lock "cinder-quobyte-684d7c53-43ef-4944-9d8a-fa61144c36f2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Deleting offline snapshot 684d7c53-43ef-4944-9d8a-fa61144c36f2 of volume 62787b56-dd07-4d25-99bd-9de20f12f64f {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] snapshot_file for this snap is: volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4347118c-451d-455f-9f3d-217bdfd1e44e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Flow 'volume_create_manager' (b7a95643-568c-4107-b241-c76e9bc4f626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192df7ee-7971-4ae5-ad87-af881692a0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192df7ee-7971-4ae5-ad87-af881692a0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a77047d-c3b6-424a-9cda-6cdab8782ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30378a0ef5dd4271bd31373673801d4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:55Z,use_quota=True,user_id='6cf3f941ea924112ac58c59f6f6e19f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f841dd99-f9ea-473f-bd5b-7f4bc956ae34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f841dd99-f9ea-473f-bd5b-7f4bc956ae34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:55 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2 Nov 06 10:59:55 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52adae4c-219a-4f97-b66d-f6ac6f1f2b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.image.glance [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Creating Keystone auth plugin from conf {{(pid=86819) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 10:59:55 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b7a1e5d6-646d-4def-b99c-c952ae61747b 1073741824" returned: 0 in 0.562s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b7a1e5d6-646d-4def-b99c-c952ae61747b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:55 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b7a1e5d6-646d-4def-b99c-c952ae61747b Nov 06 10:59:55 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52adae4c-219a-4f97-b66d-f6ac6f1f2b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a77047d-c3b6-424a-9cda-6cdab8782ebb', 'volume_name': 'volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb', 'volume_size': 1, 'image_id': '26a76d3d-9f01-46c6-acdb-067a782465db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26a76d3d-9f01-46c6-acdb-067a782465db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bb18a043571c247577bf1ddf1b59a2d2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30378a0ef5dd4271bd31373673801d4b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b95e7b6c043e5d87fb956739248993df68c442ce5bac98b05c77679a3d2567749c0e73e4e5c4dfb74acddf4f761ad683f187d2cee5e623321f194798ccb2a77', 'id': '26a76d3d-9f01-46c6-acdb-067a782465db', 'created_at': datetime.datetime(2026, 11, 6, 9, 59, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 59, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26a76d3d-9f01-46c6-acdb-067a782465db/file', 'properties': {}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d4d823-5007-409a-b97b-c217cbdecd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d4d823-5007-409a-b97b-c217cbdecd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8869d1ba-55be-4247-8f64-b48e1fb75ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:55 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Volume 1a77047d-c3b6-424a-9cda-6cdab8782ebb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb', 'volume_size': 1, 'image_id': '26a76d3d-9f01-46c6-acdb-067a782465db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26a76d3d-9f01-46c6-acdb-067a782465db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bb18a043571c247577bf1ddf1b59a2d2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30378a0ef5dd4271bd31373673801d4b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b95e7b6c043e5d87fb956739248993df68c442ce5bac98b05c77679a3d2567749c0e73e4e5c4dfb74acddf4f761ad683f187d2cee5e623321f194798ccb2a77', 'id': '26a76d3d-9f01-46c6-acdb-067a782465db', 'created_at': datetime.datetime(2026, 11, 6, 9, 59, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 59, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26a76d3d-9f01-46c6-acdb-067a782465db/file', 'properties': {}}, 'image_service': } Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Trying to clone 1a77047d-c3b6-424a-9cda-6cdab8782ebb from image 26a76d3d-9f01-46c6-acdb-067a782465db at location (None, [{'url': 'file:///opt/stack/data/glance/images/26a76d3d-9f01-46c6-acdb-067a782465db', 'metadata': {}}]). {{(pid=86819) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 10:59:55 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2" returned: 0 in 0.457s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62787b56-dd07-4d25-99bd-9de20f12f64f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5241168a-b4f3-4ea5-ad46-725b33de253e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 10:59:55 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Image download 0.00 MB at 0.00 MB/s Nov 06 10:59:55 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7533a2b9-578e-4683-8332-c48689e6110f]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b7a1e5d6-646d-4def-b99c-c952ae61747b" returned: 0 in 0.302s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.611s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1243519894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0a74bd-2102-418a-b434-a7e85b10474b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918a3e3271794663b48088d3d0181234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:53Z,use_quota=True,user_id='1c310a12751c4ae5aa85db3bdcc37eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Creating volume 5b0a74bd-2102-418a-b434-a7e85b10474b {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:55 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f Nov 06 10:59:55 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:55 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b0a74bd-2102-418a-b434-a7e85b10474b 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:56 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b0a74bd-2102-418a-b434-a7e85b10474b 1073741824 Nov 06 10:59:56 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d4caee-eb49-496c-8a2f-604c7616daba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a1e5d6-646d-4def-b99c-c952ae61747b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4928e0a-48b1-4965-889c-ab4ec33bcede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:56 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume volume-b7a1e5d6-646d-4def-b99c-c952ae61747b (b7a1e5d6-646d-4def-b99c-c952ae61747b): created successfully Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4928e0a-48b1-4965-889c-ab4ec33bcede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Flow 'volume_create_manager' (c19167f8-dfa7-4317-a31e-233fdb12df4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:56 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7e1cb1b5-e7c4-4567-92d8-f2eb45ca687d tempest-CreateVolumesFromSnapshotTest-1678045730 None] Created volume successfully. Nov 06 10:59:56 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD Nov 06 10:59:56 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:56 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f" returned: 0 in 0.436s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:56 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2 Nov 06 10:59:56 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:56 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:56 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b0a74bd-2102-418a-b434-a7e85b10474b 1073741824" returned: 0 in 0.496s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:56 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD Nov 06 10:59:56 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b0a74bd-2102-418a-b434-a7e85b10474b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:56 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b0a74bd-2102-418a-b434-a7e85b10474b Nov 06 10:59:56 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:56 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2" returned: 0 in 0.401s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:56 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2 Nov 06 10:59:56 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:56 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Temporary image 26a76d3d-9f01-46c6-acdb-067a782465db is fetched for user 6cf3f941ea924112ac58c59f6f6e19f1. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 10:59:56 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b0a74bd-2102-418a-b434-a7e85b10474b" returned: 0 in 0.274s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.981s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-40508134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1375ad38-69d4-4ca0-824c-b3632710ab37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918a3e3271794663b48088d3d0181234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:54Z,use_quota=True,user_id='1c310a12751c4ae5aa85db3bdcc37eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Creating volume 1375ad38-69d4-4ca0-824c-b3632710ab37 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:56 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1375ad38-69d4-4ca0-824c-b3632710ab37 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bef7815-133b-4586-af30-c99800399501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b0a74bd-2102-418a-b434-a7e85b10474b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:56 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1375ad38-69d4-4ca0-824c-b3632710ab37 1073741824 Nov 06 10:59:56 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (387f9286-9410-4f00-9d80-21de579c6e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa577d20-509b-4bb6-badb-c02902a61676]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:56 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume volume-5b0a74bd-2102-418a-b434-a7e85b10474b (5b0a74bd-2102-418a-b434-a7e85b10474b): created successfully Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (387f9286-9410-4f00-9d80-21de579c6e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Flow 'volume_create_manager' (72eea8b3-00f8-4162-839f-37f76e537573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:56 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-96acccc9-da63-48b7-bbc1-832961c7036a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Created volume successfully. Nov 06 10:59:56 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f.684d7c53-43ef-4944-9d8a-fa61144c36f2" returned: 0 in 0.272s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Lock "cinder-quobyte-684d7c53-43ef-4944-9d8a-fa61144c36f2" released by "_delete_snapshot" :: held 1.707s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:56 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD Nov 06 10:59:56 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:56 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Lock "cinder-quobyte-62787b56-dd07-4d25-99bd-9de20f12f64f" released by "delete_snapshot" :: held 1.736s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Created reservations ['c779a850-0bed-4324-abd7-198d3a642441', '1ddc10f5-d008-4789-a7da-98581e4490e4', '10cebd5d-0cf8-4f52-b4a4-65d19a5552b1', '2b3c5d55-5def-490d-9ea7-7922f3e138b1'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:57 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Delete snapshot completed successfully. Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-c49a66d8-0809-4d0e-90aa-cf589d41834d tempest-CinderUnicodeTest-453913821 None] Lock "cinder-684d7c53-43ef-4944-9d8a-fa61144c36f2-delete_snapshot" released by "delete_snapshot" :: held 1.925s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:57 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:57 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1375ad38-69d4-4ca0-824c-b3632710ab37 1073741824" returned: 0 in 0.481s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:57 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD Nov 06 10:59:57 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1375ad38-69d4-4ca0-824c-b3632710ab37 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Acquiring lock "cinder-62787b56-dd07-4d25-99bd-9de20f12f64f-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:57 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1375ad38-69d4-4ca0-824c-b3632710ab37 Nov 06 10:59:57 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Lock "cinder-62787b56-dd07-4d25-99bd-9de20f12f64f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Acquiring lock "cinder-quobyte-62787b56-dd07-4d25-99bd-9de20f12f64f" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Lock "cinder-quobyte-62787b56-dd07-4d25-99bd-9de20f12f64f" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1830c10d-737c-4a1f-b208-4e326ed7749f]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:57 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:57 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f Nov 06 10:59:57 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:57 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1375ad38-69d4-4ca0-824c-b3632710ab37" returned: 0 in 0.320s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.507s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145860368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b701f87-9946-4f8a-b5bb-71573757d308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918a3e3271794663b48088d3d0181234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:54Z,use_quota=True,user_id='1c310a12751c4ae5aa85db3bdcc37eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Creating volume 2b701f87-9946-4f8a-b5bb-71573757d308 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:57 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2b701f87-9946-4f8a-b5bb-71573757d308 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71de1db0-da25-4686-a9fa-148c40a97a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1375ad38-69d4-4ca0-824c-b3632710ab37', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6f28b8-ac0a-4533-945b-2bc545e7d3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:57 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2b701f87-9946-4f8a-b5bb-71573757d308 1073741824 Nov 06 10:59:57 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:57 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume volume-1375ad38-69d4-4ca0-824c-b3632710ab37 (1375ad38-69d4-4ca0-824c-b3632710ab37): created successfully Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6f28b8-ac0a-4533-945b-2bc545e7d3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Flow 'volume_create_manager' (a54daa65-6707-4e52-8556-3370ed390033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:57 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-26087433-04fd-4d33-84ee-478a8f2475b8 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Created volume successfully. Nov 06 10:59:57 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f" returned: 0 in 0.378s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:57 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f Nov 06 10:59:57 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:58 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2b701f87-9946-4f8a-b5bb-71573757d308 1073741824" returned: 0 in 0.441s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2b701f87-9946-4f8a-b5bb-71573757d308 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:58 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-62787b56-dd07-4d25-99bd-9de20f12f64f" returned: 0 in 0.275s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:58 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2b701f87-9946-4f8a-b5bb-71573757d308 Nov 06 10:59:58 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Lock "cinder-quobyte-62787b56-dd07-4d25-99bd-9de20f12f64f" released by "delete_volume" :: held 0.729s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Created reservations ['5dfb5f52-f231-41b0-9351-6bbf6f91ae79', 'e2b57c8b-4593-4de6-b528-49ea427cb502', 'c647ac54-dc3f-4007-b4cb-710e6a576388', '12071e66-8d23-4bbc-836f-3b5b9e3a915c'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:58 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:58 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:58 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2b701f87-9946-4f8a-b5bb-71573757d308" returned: 0 in 0.261s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.873s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-43778382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918a3e3271794663b48088d3d0181234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:54Z,use_quota=True,user_id='1c310a12751c4ae5aa85db3bdcc37eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Creating volume 47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 10:59:58 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd36185-5e1f-446c-9923-1219fd163b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b701f87-9946-4f8a-b5bb-71573757d308', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:58 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d 1073741824 Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ebc9ac-e8cd-4752-b86a-4d6608d591a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:58 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:58 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume volume-2b701f87-9946-4f8a-b5bb-71573757d308 (2b701f87-9946-4f8a-b5bb-71573757d308): created successfully Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ebc9ac-e8cd-4752-b86a-4d6608d591a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Flow 'volume_create_manager' (b66667b3-e1b1-486d-9af1-bc67826a4ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:58 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-0f8087b1-087f-467a-bf2c-9fab041a453b tempest-CreateVolumesFromSnapshotTest-1678045730 None] Created volume successfully. Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Acquiring lock "cinder-ec2bd6f2-f616-43e1-831b-4f4ac5048613-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Lock "cinder-ec2bd6f2-f616-43e1-831b-4f4ac5048613-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Acquiring lock "cinder-quobyte-ec2bd6f2-f616-43e1-831b-4f4ac5048613" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 10:59:58 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.303s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:58 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Deleted volume successfully. Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Lock "cinder-quobyte-ec2bd6f2-f616-43e1-831b-4f4ac5048613" acquired by "delete_volume" :: waited 0.036s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-debdef51-ce8a-4c36-a824-42b915ef8e9d tempest-CinderUnicodeTest-453913821 None] Lock "cinder-62787b56-dd07-4d25-99bd-9de20f12f64f-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d566cd-dbc2-47a0-adf6-64d46eabbef3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:58 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613 Nov 06 10:59:58 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:59 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d 1073741824" returned: 0 in 0.554s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:59 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d Nov 06 10:59:59 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:59 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613" returned: 0 in 0.409s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:59 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613 Nov 06 10:59:59 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:59 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d" returned: 0 in 0.250s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.228s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] Creating offline snapshot bac1e218-ed22-45ef-a92b-6e0c93e35924 of volume f7186a02-631a-4807-bea0-4cfb1d5765da {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25d558c-cde4-487a-b696-9f3932ae5b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c4c865-a200-440d-b136-bb5941dc4e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f821f3d-e3e5-49f7-bd46-ffa8f5ceee6a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:59 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:59 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Volume volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d (47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d): created successfully Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c4c865-a200-440d-b136-bb5941dc4e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Flow 'volume_create_manager' (1d7380f5-750c-4bac-aeeb-f85746afa7b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-ec2bd6f2-f616-43e1-831b-4f4ac5048613" returned: 0 in 0.290s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Lock "cinder-quobyte-ec2bd6f2-f616-43e1-831b-4f4ac5048613" released by "delete_volume" :: held 0.753s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 10:59:59 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-758f7526-3598-48dc-9cb3-afc3420fd422 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Created volume successfully. Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Created reservations ['e0556855-d6b5-407f-9c5a-2b4f7896b651', 'f8d89149-6c44-4020-a109-ab1cd6722036', 'e1587825-1ce7-4128-9e0a-2876cb789fcf', '42b3c330-9e1b-4ae2-81b2-1b75150f9837'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 10:59:59 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da Nov 06 10:59:59 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:59 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 10:59:59 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:59 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da" returned: 0 in 0.418s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 10:59:59 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924 1G Nov 06 10:59:59 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 10:59:59 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.275s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 10:59:59 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Deleted volume successfully. Nov 06 10:59:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-41bd83aa-036e-4cde-b569-9ea611301562 tempest-CinderUnicodeTest-453913821 None] Lock "cinder-ec2bd6f2-f616-43e1-831b-4f4ac5048613-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "cinder-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "cinder-quobyte-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d" acquired by "delete_volume" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[81900f15-9dbf-4aa4-b5a5-e83850271cf0]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:00 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924 1G" returned: 0 in 0.516s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7186a02-631a-4807-bea0-4cfb1d5765da -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:00 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7186a02-631a-4807-bea0-4cfb1d5765da -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924 Nov 06 11:00:00 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:00 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d Nov 06 11:00:00 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:00 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7186a02-631a-4807-bea0-4cfb1d5765da -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924" returned: 0 in 0.365s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:00 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924 is being set with open permissions: ugo+rw Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:00 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924 Nov 06 11:00:00 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:00 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d" returned: 0 in 0.473s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:00 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d Nov 06 11:00:00 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:00 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924" returned: 0 in 0.265s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:00 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d" returned: 0 in 0.272s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d" released by "delete_volume" :: held 0.796s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:00 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.info Nov 06 11:00:00 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Created reservations ['c5363c94-fac4-456d-a3b7-b4dfeb0b150c', 'efb5055f-d883-4b09-8ee8-0fcb55624b36', '4465daad-6cc1-4fc1-9133-e25b4eb9b2be', '8c200be1-b7e2-44f3-a1cf-0bd76e64542a'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:01 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:01 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:01 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.info" returned: 0 in 0.305s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:01 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.info is being set with open permissions: ugo+rw Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:01 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.info Nov 06 11:00:01 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "cinder-2b701f87-9946-4f8a-b5bb-71573757d308-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-2b701f87-9946-4f8a-b5bb-71573757d308-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "cinder-quobyte-2b701f87-9946-4f8a-b5bb-71573757d308" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-2b701f87-9946-4f8a-b5bb-71573757d308" acquired by "delete_volume" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:01 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.344s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:01 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Deleted volume successfully. Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81ac428-8102-4d31-b4ff-2ddcc5016be7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2b701f87-9946-4f8a-b5bb-71573757d308 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-530ec80a-ae3c-4b6d-b77f-5f53931c54ce tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-47bef9c7-2f5d-4f1f-960a-1b3cdf6c701d-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:01 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.info" returned: 0 in 0.346s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.058s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T09:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a77047d-c3b6-424a-9cda-6cdab8782ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30378a0ef5dd4271bd31373673801d4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T09:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T09:59:55Z,use_quota=True,user_id='6cf3f941ea924112ac58c59f6f6e19f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Creating volume 1a77047d-c3b6-424a-9cda-6cdab8782ebb {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:01 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:01 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2b701f87-9946-4f8a-b5bb-71573757d308 Nov 06 11:00:01 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:01 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb 1073741824 Nov 06 11:00:01 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:01 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-67e6c179-74a0-4979-98e0-a122b7b33c5e tempest-ProjectMemberTests-348771717 None] Create snapshot completed successfully Nov 06 11:00:01 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2b701f87-9946-4f8a-b5bb-71573757d308" returned: 0 in 0.460s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2b701f87-9946-4f8a-b5bb-71573757d308 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:02 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2b701f87-9946-4f8a-b5bb-71573757d308 Nov 06 11:00:02 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:02 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb 1073741824" returned: 0 in 0.541s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:02 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb Nov 06 11:00:02 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:02 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-2b701f87-9946-4f8a-b5bb-71573757d308" returned: 0 in 0.302s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-2b701f87-9946-4f8a-b5bb-71573757d308" released by "delete_volume" :: held 0.845s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-bac1e218-ed22-45ef-a92b-6e0c93e35924-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Created reservations ['ec786ca2-aea1-472f-a225-2d00e9e66132', '5cc1377d-55d6-4a64-a6d1-6f502fd7f6a8', 'd5bf715b-ddef-4357-8115-8a556c9a5b4c', '3bbdf368-eb2d-48a6-afed-85baa19b0830'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Lock "cinder-bac1e218-ed22-45ef-a92b-6e0c93e35924-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-f7186a02-631a-4807-bea0-4cfb1d5765da" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-f7186a02-631a-4807-bea0-4cfb1d5765da" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-bac1e218-ed22-45ef-a92b-6e0c93e35924" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-bac1e218-ed22-45ef-a92b-6e0c93e35924" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Deleting offline snapshot bac1e218-ed22-45ef-a92b-6e0c93e35924 of volume f7186a02-631a-4807-bea0-4cfb1d5765da {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] snapshot_file for this snap is: volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a764267f-db52-4d5d-aff5-b5029efac862]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:02 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb" returned: 0 in 0.368s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Attempting download of 26a76d3d-9f01-46c6-acdb-067a782465db ((None, [{'url': 'file:///opt/stack/data/glance/images/26a76d3d-9f01-46c6-acdb-067a782465db', 'metadata': {}}])) to volume 1a77047d-c3b6-424a-9cda-6cdab8782ebb. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 11:00:02 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:02 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fd14f6-5c3f-42f4-94f6-83fbad7ce65d]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26a76d3d-9f01-46c6-acdb-067a782465db_kh4vewgy {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:02 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924 Nov 06 11:00:02 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:02 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26a76d3d-9f01-46c6-acdb-067a782465db_kh4vewgy Nov 06 11:00:02 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:03 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.378s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:03 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Deleted volume successfully. Nov 06 11:00:03 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924" returned: 0 in 0.480s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7186a02-631a-4807-bea0-4cfb1d5765da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7d9d6132-d49f-4c4c-b24d-26474d5bdbb2 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-2b701f87-9946-4f8a-b5bb-71573757d308-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9cf085-2405-4bb7-9388-da972749c7fb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:03 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26a76d3d-9f01-46c6-acdb-067a782465db_kh4vewgy" returned: 0 in 0.464s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26a76d3d-9f01-46c6-acdb-067a782465db_kh4vewgy {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:03 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da Nov 06 11:00:03 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:03 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26a76d3d-9f01-46c6-acdb-067a782465db_kh4vewgy Nov 06 11:00:03 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:03 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da" returned: 0 in 0.416s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:03 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26a76d3d-9f01-46c6-acdb-067a782465db_kh4vewgy" returned: 1 in 0.340s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26a76d3d-9f01-46c6-acdb-067a782465db_kh4vewgy' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[48149a86-b3f9-4849-bdee-0fc3c74f227b]: (4, 'raw') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:03 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924 Nov 06 11:00:03 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "cinder-1375ad38-69d4-4ca0-824c-b3632710ab37-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-1375ad38-69d4-4ca0-824c-b3632710ab37-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:03 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD Nov 06 11:00:03 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "cinder-quobyte-1375ad38-69d4-4ca0-824c-b3632710ab37" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-1375ad38-69d4-4ca0-824c-b3632710ab37" acquired by "delete_volume" :: waited 0.027s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91ac463-aad5-4031-b7b6-41abe4b2dce7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1375ad38-69d4-4ca0-824c-b3632710ab37 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:03 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1375ad38-69d4-4ca0-824c-b3632710ab37 Nov 06 11:00:03 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:04 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924" returned: 0 in 0.480s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:04 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:04 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924 Nov 06 11:00:04 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:04 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD Nov 06 11:00:04 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:04 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1375ad38-69d4-4ca0-824c-b3632710ab37" returned: 0 in 0.477s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1375ad38-69d4-4ca0-824c-b3632710ab37 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:04 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:04 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1375ad38-69d4-4ca0-824c-b3632710ab37 Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da.bac1e218-ed22-45ef-a92b-6e0c93e35924" returned: 0 in 0.322s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:04 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-bac1e218-ed22-45ef-a92b-6e0c93e35924" released by "_delete_snapshot" :: held 1.863s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-f7186a02-631a-4807-bea0-4cfb1d5765da" released by "delete_snapshot" :: held 1.916s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:04 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] 26a76d3d-9f01-46c6-acdb-067a782465db was raw, converting to qcow2 {{(pid=86819) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:04 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb Nov 06 11:00:04 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Created reservations ['18dee40f-3c66-405b-854b-cba31c8a6d03', '36ffefcf-c7e6-430d-b952-2a774b7d2250', '87917126-d2ee-4e0f-b724-b9a6d88cbfb5', '0ce7b946-67da-448b-9ed7-ae9cfdb498cb'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:04 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Delete snapshot completed successfully. Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5d8d2dd9-1233-4dbd-b03a-5eeb669f5ace tempest-ProjectMemberTests-348771717 None] Lock "cinder-bac1e218-ed22-45ef-a92b-6e0c93e35924-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:04 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1375ad38-69d4-4ca0-824c-b3632710ab37" returned: 0 in 0.284s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-1375ad38-69d4-4ca0-824c-b3632710ab37" released by "delete_volume" :: held 0.822s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-f7186a02-631a-4807-bea0-4cfb1d5765da-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Lock "cinder-f7186a02-631a-4807-bea0-4cfb1d5765da-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Created reservations ['1a98d842-b546-4208-817d-ef6dcb848d21', 'f90fb6b8-75a4-4fa9-b58b-cf7c1858430a', 'f5f846f4-d6d8-4871-8c41-72ce30402f18', '1561359c-7c22-4801-ad0d-b4e8123d3685'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-f7186a02-631a-4807-bea0-4cfb1d5765da" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-f7186a02-631a-4807-bea0-4cfb1d5765da" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29f903c-faf5-4c30-b58d-e28b3ce3bf6d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "cinder-5b0a74bd-2102-418a-b434-a7e85b10474b-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-5b0a74bd-2102-418a-b434-a7e85b10474b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:04 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:04 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:04 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da Nov 06 11:00:04 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "cinder-quobyte-5b0a74bd-2102-418a-b434-a7e85b10474b" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:04 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb" returned: 0 in 0.570s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26a76d3d-9f01-46c6-acdb-067a782465db_9mle83wydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 11:00:04 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 11:00:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-5b0a74bd-2102-418a-b434-a7e85b10474b" acquired by "delete_volume" :: waited 0.048s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:05 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb 1G Nov 06 11:00:05 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd135ef-f44e-4bbc-b879-bba252252c4d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b0a74bd-2102-418a-b434-a7e85b10474b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:05 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.309s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:05 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Deleted volume successfully. Nov 06 11:00:05 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b0a74bd-2102-418a-b434-a7e85b10474b Nov 06 11:00:05 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-96e29737-5d30-4e2e-8673-c67b1d4cf1a5 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-1375ad38-69d4-4ca0-824c-b3632710ab37-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:05 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da" returned: 0 in 0.509s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:05 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da Nov 06 11:00:05 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:05 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb 1G" returned: 0 in 0.413s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Downloaded image 26a76d3d-9f01-46c6-acdb-067a782465db ((None, [{'url': 'file:///opt/stack/data/glance/images/26a76d3d-9f01-46c6-acdb-067a782465db', 'metadata': {}}])) to volume 1a77047d-c3b6-424a-9cda-6cdab8782ebb successfully. {{(pid=86819) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Temporary image 26a76d3d-9f01-46c6-acdb-067a782465db for user 6cf3f941ea924112ac58c59f6f6e19f1 is deleted. {{(pid=86819) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.volume.volume_utils [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Marking volume 1a77047d-c3b6-424a-9cda-6cdab8782ebb as bootable. {{(pid=86819) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Copying metadata from image 26a76d3d-9f01-46c6-acdb-067a782465db to 1a77047d-c3b6-424a-9cda-6cdab8782ebb. {{(pid=86819) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Creating volume glance metadata for volume 1a77047d-c3b6-424a-9cda-6cdab8782ebb backed by image 26a76d3d-9f01-46c6-acdb-067a782465db with: {'image_id': '26a76d3d-9f01-46c6-acdb-067a782465db', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'bb18a043571c247577bf1ddf1b59a2d2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86819) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8869d1ba-55be-4247-8f64-b48e1fb75ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb', 'volume_size': 1, 'image_id': '26a76d3d-9f01-46c6-acdb-067a782465db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26a76d3d-9f01-46c6-acdb-067a782465db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bb18a043571c247577bf1ddf1b59a2d2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30378a0ef5dd4271bd31373673801d4b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b95e7b6c043e5d87fb956739248993df68c442ce5bac98b05c77679a3d2567749c0e73e4e5c4dfb74acddf4f761ad683f187d2cee5e623321f194798ccb2a77', 'id': '26a76d3d-9f01-46c6-acdb-067a782465db', 'created_at': datetime.datetime(2026, 11, 6, 9, 59, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 9, 59, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26a76d3d-9f01-46c6-acdb-067a782465db/file', 'properties': {}}, 'image_service': }' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83ad091-2541-4c50-bbd9-d83acd008c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:05 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Volume volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb (1a77047d-c3b6-424a-9cda-6cdab8782ebb): created successfully Nov 06 11:00:05 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83ad091-2541-4c50-bbd9-d83acd008c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Flow 'volume_create_manager' (b7a95643-568c-4107-b241-c76e9bc4f626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b0a74bd-2102-418a-b434-a7e85b10474b" returned: 0 in 0.508s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b0a74bd-2102-418a-b434-a7e85b10474b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:05 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-39211344-829b-48f3-a4ea-94c7f0c9a51f tempest-VolumeImageDependencyTests-1498916697 None] Created volume successfully. Nov 06 11:00:05 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b0a74bd-2102-418a-b434-a7e85b10474b Nov 06 11:00:05 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:05 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f7186a02-631a-4807-bea0-4cfb1d5765da" returned: 0 in 0.321s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-f7186a02-631a-4807-bea0-4cfb1d5765da" released by "delete_volume" :: held 0.910s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Created reservations ['ec309515-812d-444f-a4c7-ef1d50a83d21', '48729444-ae6b-4ab7-b53f-fac68a969336', '40d531fa-a682-46d9-94a9-1b764de86088', '8e7820dd-f38e-45c0-9d96-e0c6fb531715'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:05 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:05 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:05 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b0a74bd-2102-418a-b434-a7e85b10474b" returned: 0 in 0.351s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-5b0a74bd-2102-418a-b434-a7e85b10474b" released by "delete_volume" :: held 0.929s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Created reservations ['1b4209ba-b377-4039-a587-579403334fa2', '244ead1e-4f1b-44aa-a313-332c09b1ef06', '8237502b-75ee-4d64-be68-6e04ce374327', 'f8468e11-cd53-4dd0-bc94-a9fcacafeedd'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:06 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:06 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:06 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.335s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:06 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Deleted volume successfully. Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5f0e2292-a61e-46a3-9438-aaa083d379d5 tempest-ProjectMemberTests-348771717 None] Lock "cinder-f7186a02-631a-4807-bea0-4cfb1d5765da-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:06 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (ec080734-e84f-4317-b010-e3db34fcb7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c83519-7560-4492-93d4-53dc06f3a0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.418s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:06 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Deleted volume successfully. Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c83519-7560-4492-93d4-53dc06f3a0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-705732025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d8828e-ae34-4ff9-a0fe-74fd55db8cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:06Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c5a378-b97d-4435-8260-6c2a7d71cfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c5a378-b97d-4435-8260-6c2a7d71cfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b0ed60-fca1-4388-b6c4-1d2da7237dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b0ed60-fca1-4388-b6c4-1d2da7237dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d8828e-ae34-4ff9-a0fe-74fd55db8cca', 'volume_name': 'volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33894c1d-9421-4d43-be1f-8379ccae50a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33894c1d-9421-4d43-be1f-8379ccae50a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648e4f83-227b-416a-893e-214b1af4c162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:06 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Volume 44d8828e-ae34-4ff9-a0fe-74fd55db8cca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca', 'volume_size': 1} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-705732025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d8828e-ae34-4ff9-a0fe-74fd55db8cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:06Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Creating volume 44d8828e-ae34-4ff9-a0fe-74fd55db8cca {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:06 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Acquiring lock "cinder-1a77047d-c3b6-424a-9cda-6cdab8782ebb-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Lock "cinder-1a77047d-c3b6-424a-9cda-6cdab8782ebb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:06 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca 1073741824 Nov 06 11:00:06 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e2e2cbba-46d6-48bd-b783-8a078a3c0544 tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-5b0a74bd-2102-418a-b434-a7e85b10474b-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Acquiring lock "cinder-quobyte-1a77047d-c3b6-424a-9cda-6cdab8782ebb" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Lock "cinder-quobyte-1a77047d-c3b6-424a-9cda-6cdab8782ebb" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5596f4-7d2a-47df-82ce-23e2b2864307]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:06 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb Nov 06 11:00:06 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:07 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca 1073741824" returned: 0 in 0.451s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "cinder-b7a1e5d6-646d-4def-b99c-c952ae61747b-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:07 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca Nov 06 11:00:07 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-b7a1e5d6-646d-4def-b99c-c952ae61747b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:07 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb" returned: 0 in 0.439s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "cinder-quobyte-b7a1e5d6-646d-4def-b99c-c952ae61747b" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:07 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb Nov 06 11:00:07 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-b7a1e5d6-646d-4def-b99c-c952ae61747b" acquired by "delete_volume" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c5ab71-20dc-4cf6-a51a-72d07c7f2ff1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b7a1e5d6-646d-4def-b99c-c952ae61747b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:07 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b7a1e5d6-646d-4def-b99c-c952ae61747b Nov 06 11:00:07 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:07 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca" returned: 0 in 0.279s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648e4f83-227b-416a-893e-214b1af4c162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3185cffa-d6ab-44bb-b91c-7a8bf8b52080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:07 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Volume volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca (44d8828e-ae34-4ff9-a0fe-74fd55db8cca): created successfully Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3185cffa-d6ab-44bb-b91c-7a8bf8b52080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (ec080734-e84f-4317-b010-e3db34fcb7a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:07 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2f69e1d9-25eb-4c02-aa96-1d526eb64c3d tempest-ProjectMemberTests-348771717 None] Created volume successfully. Nov 06 11:00:07 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-1a77047d-c3b6-424a-9cda-6cdab8782ebb" returned: 0 in 0.288s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Lock "cinder-quobyte-1a77047d-c3b6-424a-9cda-6cdab8782ebb" released by "delete_volume" :: held 0.787s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Created reservations ['0294b149-1e00-4f11-9771-5ee3dcfca3cb', 'b9226cb9-145d-4bb6-bae1-90e2d7032913', '28f40b13-ccd5-4446-9951-a38dce7ae11c', '656449bc-4ffe-4746-8222-54291c64599b'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:07 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:07 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:07 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b7a1e5d6-646d-4def-b99c-c952ae61747b" returned: 0 in 0.522s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b7a1e5d6-646d-4def-b99c-c952ae61747b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:07 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b7a1e5d6-646d-4def-b99c-c952ae61747b Nov 06 11:00:07 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] Creating offline snapshot ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 of volume 44d8828e-ae34-4ff9-a0fe-74fd55db8cca {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f1bc32-0554-4288-8cbd-c7ccd00c4b9d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:07 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.347s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:08 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Deleted volume successfully. Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3d56b100-5e5f-4fa7-97f6-92d0b925af4a tempest-VolumeImageDependencyTests-1498916697 None] Lock "cinder-1a77047d-c3b6-424a-9cda-6cdab8782ebb-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:08 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:08 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca Nov 06 11:00:08 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-b7a1e5d6-646d-4def-b99c-c952ae61747b" returned: 0 in 0.332s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-b7a1e5d6-646d-4def-b99c-c952ae61747b" released by "delete_volume" :: held 0.905s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Created reservations ['9ff13e8f-cadb-4bad-bdf3-3b893776c270', '88b1d3a0-da22-420f-b032-96e6dafa4f75', '66dbc2c2-9a94-401a-ba0a-24eb2fb8e363', 'd74e6463-bfe4-41a6-bc96-4ae69d5f9850'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:08 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:08 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "cinder-a360e10c-86f6-4276-b40e-bd31774d81ed-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:08 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca" returned: 0 in 0.561s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-a360e10c-86f6-4276-b40e-bd31774d81ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.120s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "cinder-quobyte-f87b1fd1-9ac6-4d77-9ad4-89f423d95299" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:08 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 1G Nov 06 11:00:08 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-f87b1fd1-9ac6-4d77-9ad4-89f423d95299" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "cinder-quobyte-a360e10c-86f6-4276-b40e-bd31774d81ed" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-a360e10c-86f6-4276-b40e-bd31774d81ed" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Deleting offline snapshot a360e10c-86f6-4276-b40e-bd31774d81ed of volume f87b1fd1-9ac6-4d77-9ad4-89f423d95299 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] snapshot_file for this snap is: volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f021188-c3eb-4bfd-a8a7-423d0539e5ba]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:08 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.372s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:08 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Deleted volume successfully. Nov 06 11:00:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-147c7c68-acbd-47e9-8b12-cbb38d8b74cf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-b7a1e5d6-646d-4def-b99c-c952ae61747b-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:08 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed Nov 06 11:00:08 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:09 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 1G" returned: 0 in 0.592s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:09 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 Nov 06 11:00:09 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:09 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed" returned: 0 in 0.476s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:00:09 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30f5e70-2149-4675-a3ee-5eb7d70c1581]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:09 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 Nov 06 11:00:09 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:09 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637" returned: 0 in 0.389s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:09 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 is being set with open permissions: ugo+rw Nov 06 11:00:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:09 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 Nov 06 11:00:09 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:09 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299" returned: 0 in 0.566s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:09 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637" returned: 0 in 0.318s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:09 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed Nov 06 11:00:09 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:09 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.info Nov 06 11:00:09 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:10 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.info" returned: 0 in 0.338s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:10 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.info is being set with open permissions: ugo+rw Nov 06 11:00:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:10 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.info Nov 06 11:00:10 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:10 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed" returned: 0 in 0.549s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:10 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed Nov 06 11:00:10 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:10 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.info" returned: 0 in 0.285s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.655s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:10 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-f546f65c-a200-4627-92ba-8c0ed723b908 tempest-ProjectMemberTests-348771717 None] Create snapshot completed successfully Nov 06 11:00:10 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299.a360e10c-86f6-4276-b40e-bd31774d81ed" returned: 0 in 0.327s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-a360e10c-86f6-4276-b40e-bd31774d81ed" released by "_delete_snapshot" :: held 2.084s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-f87b1fd1-9ac6-4d77-9ad4-89f423d95299" released by "delete_snapshot" :: held 2.139s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:10 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Created reservations ['901b2288-415d-49fe-a6dc-de05accafa2f', 'f93753c9-34ac-42e9-ac66-8b5ce4944efb', '8fefad61-a2aa-4d4a-beff-2a0b26d45337', '4cc517fb-df99-4edb-982d-875f8e138a41'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:10 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Delete snapshot completed successfully. Nov 06 11:00:10 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-0f6d97d8-72ab-4e36-89bb-d5e55b8f30bf tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-a360e10c-86f6-4276-b40e-bd31774d81ed-delete_snapshot" released by "delete_snapshot" :: held 2.312s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-ca3d276e-c1dd-41d4-b60b-8bcbd4e75637-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Lock "cinder-ca3d276e-c1dd-41d4-b60b-8bcbd4e75637-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-44d8828e-ae34-4ff9-a0fe-74fd55db8cca" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-44d8828e-ae34-4ff9-a0fe-74fd55db8cca" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-ca3d276e-c1dd-41d4-b60b-8bcbd4e75637" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-ca3d276e-c1dd-41d4-b60b-8bcbd4e75637" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Deleting offline snapshot ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 of volume 44d8828e-ae34-4ff9-a0fe-74fd55db8cca {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] snapshot_file for this snap is: volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7d62d0-3899-4dc7-a42b-3d83c15838b0]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:11 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 Nov 06 11:00:11 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:11 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637" returned: 0 in 0.394s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa06329-ec44-464c-82d9-d0d3a0cdab0d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "cinder-f87b1fd1-9ac6-4d77-9ad4-89f423d95299-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:11 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca Nov 06 11:00:11 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-f87b1fd1-9ac6-4d77-9ad4-89f423d95299-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "cinder-quobyte-f87b1fd1-9ac6-4d77-9ad4-89f423d95299" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-f87b1fd1-9ac6-4d77-9ad4-89f423d95299" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[a842d96c-4a0f-4c9a-a0a6-34abdf0a8d03]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:11 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 Nov 06 11:00:11 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:12 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca" returned: 0 in 0.463s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:12 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 Nov 06 11:00:12 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:12 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299" returned: 0 in 0.470s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:12 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299 Nov 06 11:00:12 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:12 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637" returned: 0 in 0.446s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:12 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637 Nov 06 11:00:12 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:12 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f87b1fd1-9ac6-4d77-9ad4-89f423d95299" returned: 0 in 0.312s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-quobyte-f87b1fd1-9ac6-4d77-9ad4-89f423d95299" released by "delete_volume" :: held 0.870s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5770a400-7fd2-4046-ae5d-1e5544d416f7 tempest-ProjectAdminTests-1488558863 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3973922729492, 'free_capacity_gb': 1773.3973922729492, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86819) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Created reservations ['4b146462-33ff-4281-90ea-64ab7890caaf', 'd1aa59f7-19e7-4b64-a3d1-f800b61a53e1', '048bd6fc-6dff-43b6-bcf9-690e6dff5143', '3807ed53-18c6-4d31-ad62-4ec93e34057a'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:12 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca.ca3d276e-c1dd-41d4-b60b-8bcbd4e75637" returned: 0 in 0.335s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:12 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:12 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-ca3d276e-c1dd-41d4-b60b-8bcbd4e75637" released by "_delete_snapshot" :: held 1.785s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-44d8828e-ae34-4ff9-a0fe-74fd55db8cca" released by "delete_snapshot" :: held 1.811s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:12 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Created reservations ['a6c98086-5676-42a9-b094-a2f63a443b00', '1ac97371-6758-4444-a1f6-87c9b9d1ccb7', '70013878-a0c9-45a8-bc47-ac2f8be027b6', 'cf244ec7-a93b-404f-a200-4b4763f96086'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:12 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Delete snapshot completed successfully. Nov 06 11:00:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-027b0ca0-4c99-4875-8737-06f3107eebe9 tempest-ProjectMemberTests-348771717 None] Lock "cinder-ca3d276e-c1dd-41d4-b60b-8bcbd4e75637-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:13 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.329s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:13 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:13 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Deleted volume successfully. Nov 06 11:00:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d450f0d8-80a2-4f7e-95da-250865d1ca6a tempest-CreateVolumesFromSnapshotTest-1678045730 None] Lock "cinder-f87b1fd1-9ac6-4d77-9ad4-89f423d95299-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-44d8828e-ae34-4ff9-a0fe-74fd55db8cca-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Lock "cinder-44d8828e-ae34-4ff9-a0fe-74fd55db8cca-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-44d8828e-ae34-4ff9-a0fe-74fd55db8cca" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-44d8828e-ae34-4ff9-a0fe-74fd55db8cca" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:13 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a42db7-fc15-425b-b7c5-50a5e1dddce9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:13 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca Nov 06 11:00:13 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:13 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca" returned: 0 in 0.549s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:13 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca Nov 06 11:00:13 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:13 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Flow 'volume_create_manager' (809fa12f-58e2-490b-8994-c5c0e7ff8418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c155df2-023c-40cd-87ea-dc66c633d906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c155df2-023c-40cd-87ea-dc66c633d906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810181947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e8fed9-1c9a-4f21-afb5-fdcb32ece01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61696977bd6d4b9ba5cce88512c37934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:14Z,use_quota=True,user_id='3ae004817bfd4243a8ceaac215753bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df874dc-74b6-46ae-aa47-b575bf36bf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df874dc-74b6-46ae-aa47-b575bf36bf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ea0372-399f-4981-abb3-d97bf60ba8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ea0372-399f-4981-abb3-d97bf60ba8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e8fed9-1c9a-4f21-afb5-fdcb32ece01e', 'volume_name': 'volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3893919a-e0e8-4a79-a109-c0d6828480d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3893919a-e0e8-4a79-a109-c0d6828480d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45dd28c6-6388-4040-b7b7-3afc1223867e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:14 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Volume 99e8fed9-1c9a-4f21-afb5-fdcb32ece01e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e', 'volume_size': 1} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810181947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e8fed9-1c9a-4f21-afb5-fdcb32ece01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61696977bd6d4b9ba5cce88512c37934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:14Z,use_quota=True,user_id='3ae004817bfd4243a8ceaac215753bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Creating volume 99e8fed9-1c9a-4f21-afb5-fdcb32ece01e {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:14 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:14 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e 1073741824 Nov 06 11:00:14 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:14 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-44d8828e-ae34-4ff9-a0fe-74fd55db8cca" returned: 0 in 0.311s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-44d8828e-ae34-4ff9-a0fe-74fd55db8cca" released by "delete_volume" :: held 0.955s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Created reservations ['60bb0a10-a728-4881-bbfe-adf580aea343', 'e887c53e-8805-4f97-ba1e-5cb8d3624a49', '09f4bdf8-478f-4c24-920c-93807ab92ddf', '9d3973ad-bca3-4daa-9fa8-a30d6980434f'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:14 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:14 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:14 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e 1073741824" returned: 0 in 0.591s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:14 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e Nov 06 11:00:14 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:14 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.389s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:14 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Deleted volume successfully. Nov 06 11:00:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-9986c535-b3a6-462f-a6e4-d1653b0ac3b8 tempest-ProjectMemberTests-348771717 None] Lock "cinder-44d8828e-ae34-4ff9-a0fe-74fd55db8cca-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:15 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e" returned: 0 in 0.340s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45dd28c6-6388-4040-b7b7-3afc1223867e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7484906d-e16a-43db-9b37-15b6c747c4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:15 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Volume volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e (99e8fed9-1c9a-4f21-afb5-fdcb32ece01e): created successfully Nov 06 11:00:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7484906d-e16a-43db-9b37-15b6c747c4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:15 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Flow 'volume_create_manager' (809fa12f-58e2-490b-8994-c5c0e7ff8418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:15 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-897187c6-1bc0-4725-80a9-68d6d5a2d6a1 tempest-ProjectReaderTests-540435476 None] Created volume successfully. Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (9d59dbe1-4b4c-4e37-8f9c-df99fb272f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71402457-5e79-40d5-a9c7-57cf29ea18dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71402457-5e79-40d5-a9c7-57cf29ea18dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1813561099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cc329d-3811-4723-a35f-e1e03b3307f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:16Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ac836b-0775-4f75-9991-b37bb0d06960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ac836b-0775-4f75-9991-b37bb0d06960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe7d526-0ccb-430c-9ad6-0a89aa98e536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe7d526-0ccb-430c-9ad6-0a89aa98e536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1cc329d-3811-4723-a35f-e1e03b3307f0', 'volume_name': 'volume-d1cc329d-3811-4723-a35f-e1e03b3307f0', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cf8cd1-9a92-4eac-ad1d-d8f950d4313c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cf8cd1-9a92-4eac-ad1d-d8f950d4313c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e4ad24-16ad-498f-8f32-eefd0d92cdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:16 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Volume d1cc329d-3811-4723-a35f-e1e03b3307f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1cc329d-3811-4723-a35f-e1e03b3307f0', 'volume_size': 1} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1813561099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cc329d-3811-4723-a35f-e1e03b3307f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:16Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Creating volume d1cc329d-3811-4723-a35f-e1e03b3307f0 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:16 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:16 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 1073741824 Nov 06 11:00:16 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Acquiring lock "cinder-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Lock "cinder-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Acquiring lock "cinder-quobyte-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Lock "cinder-quobyte-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e" acquired by "delete_volume" :: waited 0.029s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fc17cc-920c-4f14-8062-ecff60f20f10]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:16 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 1073741824" returned: 0 in 0.571s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:16 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 Nov 06 11:00:16 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:16 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e Nov 06 11:00:16 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Flow 'volume_create_manager' (4f1e913d-9bd8-4359-83c7-09fcd7b26c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4fc4a0-4f56-49ab-bc13-3a3025ae25a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4fc4a0-4f56-49ab-bc13-3a3025ae25a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2142587534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd690a12-957c-4e61-a0a9-d3105183fb4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b30556654d403ab0e4fbacb56d9db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:17Z,use_quota=True,user_id='c4f640d6535d4d9c808d6e68a374aaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f14b821-5c61-42b0-a64a-9a8651998b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f14b821-5c61-42b0-a64a-9a8651998b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8217ee-4b8b-4f38-881c-e3b5d3c02b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8217ee-4b8b-4f38-881c-e3b5d3c02b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd690a12-957c-4e61-a0a9-d3105183fb4f', 'volume_name': 'volume-fd690a12-957c-4e61-a0a9-d3105183fb4f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d13a114-3113-447f-ba29-6d7701953532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d13a114-3113-447f-ba29-6d7701953532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:17 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33192f00-942e-418f-9fe0-c7b7346bea94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:17 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume fd690a12-957c-4e61-a0a9-d3105183fb4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd690a12-957c-4e61-a0a9-d3105183fb4f', 'volume_size': 1} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0" returned: 0 in 0.415s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2142587534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd690a12-957c-4e61-a0a9-d3105183fb4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b30556654d403ab0e4fbacb56d9db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:17Z,use_quota=True,user_id='c4f640d6535d4d9c808d6e68a374aaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Creating volume fd690a12-957c-4e61-a0a9-d3105183fb4f {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:17 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:17 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fd690a12-957c-4e61-a0a9-d3105183fb4f 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e" returned: 0 in 0.579s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:17 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fd690a12-957c-4e61-a0a9-d3105183fb4f 1073741824 Nov 06 11:00:17 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e4ad24-16ad-498f-8f32-eefd0d92cdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1cc329d-3811-4723-a35f-e1e03b3307f0', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc79bdc-3cc6-4b62-99c1-fecff9f4c942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:17 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e Nov 06 11:00:17 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:17 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Volume volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 (d1cc329d-3811-4723-a35f-e1e03b3307f0): created successfully Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc79bdc-3cc6-4b62-99c1-fecff9f4c942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (9d59dbe1-4b4c-4e37-8f9c-df99fb272f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:17 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-9428f12e-b007-4d11-9f43-1c5f9236a071 tempest-ProjectMemberTests-348771717 None] Created volume successfully. Nov 06 11:00:17 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e" returned: 0 in 0.284s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Lock "cinder-quobyte-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e" released by "delete_volume" :: held 0.922s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Created reservations ['e575d18f-b4e7-4809-9792-747e9338f896', '072a2591-07af-431e-89d1-604a8218ee59', '1fc64054-0a5f-4bec-a0cb-83c280496994', 'bcdc012d-b08d-48e5-aeb0-cfe0f6b73833'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:17 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:17 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:17 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fd690a12-957c-4e61-a0a9-d3105183fb4f 1073741824" returned: 0 in 0.555s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=226,cinder:UPDATE=291,cinder:DELETE=31,cinder:INSERT=81 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:00:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fd690a12-957c-4e61-a0a9-d3105183fb4f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:17 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fd690a12-957c-4e61-a0a9-d3105183fb4f Nov 06 11:00:17 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:18 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.343s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:18 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Deleted volume successfully. Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=307,cinder:SELECT=233,cinder:INSERT=85,cinder:DELETE=21 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-226a067f-6d5f-4203-a837-da3474bbea55 tempest-ProjectReaderTests-540435476 None] Lock "cinder-99e8fed9-1c9a-4f21-afb5-fdcb32ece01e-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:18 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fd690a12-957c-4e61-a0a9-d3105183fb4f" returned: 0 in 0.430s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33192f00-942e-418f-9fe0-c7b7346bea94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd690a12-957c-4e61-a0a9-d3105183fb4f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1661ec1-b6ef-4023-ba42-ed8a31bff76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:18 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume volume-fd690a12-957c-4e61-a0a9-d3105183fb4f (fd690a12-957c-4e61-a0a9-d3105183fb4f): created successfully Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1661ec1-b6ef-4023-ba42-ed8a31bff76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Flow 'volume_create_manager' (4f1e913d-9bd8-4359-83c7-09fcd7b26c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:18 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-52a21bcd-9e18-43af-9233-fda9b1f9f636 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Created volume successfully. Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Flow 'volume_create_manager' (9e036aed-d57a-4fd1-81ee-f12d6aabebc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d3a1ca-67bf-42cf-b892-58c1c55e2a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d3a1ca-67bf-42cf-b892-58c1c55e2a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259742285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1b304c-d1dc-4b80-97c5-c38668bba959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61696977bd6d4b9ba5cce88512c37934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:18Z,use_quota=True,user_id='3ae004817bfd4243a8ceaac215753bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cd298d-77fa-4763-b4db-6da5259f1f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cd298d-77fa-4763-b4db-6da5259f1f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ecb9478-3668-4647-9b67-9ede25d6ff8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ecb9478-3668-4647-9b67-9ede25d6ff8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de1b304c-d1dc-4b80-97c5-c38668bba959', 'volume_name': 'volume-de1b304c-d1dc-4b80-97c5-c38668bba959', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23908f6f-4e7b-4dbf-b64d-5bb9c4abba12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23908f6f-4e7b-4dbf-b64d-5bb9c4abba12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f6f7fd-0c0b-43e3-b114-565d36a0b547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:18 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Volume de1b304c-d1dc-4b80-97c5-c38668bba959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de1b304c-d1dc-4b80-97c5-c38668bba959', 'volume_size': 1} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259742285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1b304c-d1dc-4b80-97c5-c38668bba959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61696977bd6d4b9ba5cce88512c37934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:18Z,use_quota=True,user_id='3ae004817bfd4243a8ceaac215753bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Creating volume de1b304c-d1dc-4b80-97c5-c38668bba959 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:18 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-de1b304c-d1dc-4b80-97c5-c38668bba959 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:18 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-de1b304c-d1dc-4b80-97c5-c38668bba959 1073741824 Nov 06 11:00:18 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:18 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-de1b304c-d1dc-4b80-97c5-c38668bba959 1073741824" returned: 0 in 0.444s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-de1b304c-d1dc-4b80-97c5-c38668bba959 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:18 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-de1b304c-d1dc-4b80-97c5-c38668bba959 Nov 06 11:00:18 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:19 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-de1b304c-d1dc-4b80-97c5-c38668bba959" returned: 0 in 0.295s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.747s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f6f7fd-0c0b-43e3-b114-565d36a0b547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1b304c-d1dc-4b80-97c5-c38668bba959', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27dc8763-956f-40a6-9c1d-306b8cfc8634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] Creating offline snapshot 4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc of volume d1cc329d-3811-4723-a35f-e1e03b3307f0 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:00:19 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Volume volume-de1b304c-d1dc-4b80-97c5-c38668bba959 (de1b304c-d1dc-4b80-97c5-c38668bba959): created successfully Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27dc8763-956f-40a6-9c1d-306b8cfc8634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Flow 'volume_create_manager' (9e036aed-d57a-4fd1-81ee-f12d6aabebc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[9167554d-0d78-41a6-81d7-90650d2d20a8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:19 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-bd0fd8cb-0607-4369-9c8f-cf50438aa432 tempest-ProjectReaderTests-540435476 None] Created volume successfully. Nov 06 11:00:19 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 Nov 06 11:00:19 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Flow 'volume_create_manager' (5aa1810c-5e43-494d-bb6f-299471ca87f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfc8554-72d5-46bb-b4c3-a1f62a703600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfc8554-72d5-46bb-b4c3-a1f62a703600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1405397257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9717f66c-23d1-4354-8b77-6eab62343ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b30556654d403ab0e4fbacb56d9db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:20Z,use_quota=True,user_id='c4f640d6535d4d9c808d6e68a374aaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc78e519-ac02-4641-89e4-f6057ca71047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc78e519-ac02-4641-89e4-f6057ca71047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034b5ca0-631f-4e07-8f56-d07e5aaa31c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:19 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034b5ca0-631f-4e07-8f56-d07e5aaa31c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9717f66c-23d1-4354-8b77-6eab62343ba5', 'volume_name': 'volume-9717f66c-23d1-4354-8b77-6eab62343ba5', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37939ff3-5de2-4d90-99eb-0c7c2a3ad6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37939ff3-5de2-4d90-99eb-0c7c2a3ad6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba12a7a-5d03-45f3-ac1e-37209335ba90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:19 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume 9717f66c-23d1-4354-8b77-6eab62343ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9717f66c-23d1-4354-8b77-6eab62343ba5', 'volume_size': 1} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0" returned: 0 in 0.578s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:19 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc 1G Nov 06 11:00:19 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Flow 'volume_create_manager' (c864c915-ce63-43c3-a4ba-499c26f48203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8f537c-9363-4bc2-a1ad-d44ba6889709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8f537c-9363-4bc2-a1ad-d44ba6889709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1736876974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b30556654d403ab0e4fbacb56d9db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:20Z,use_quota=True,user_id='c4f640d6535d4d9c808d6e68a374aaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df81eeca-9b60-402d-aa53-1ff166a21765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df81eeca-9b60-402d-aa53-1ff166a21765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9382e1e4-db85-47e5-a9a2-adc790f9030d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9382e1e4-db85-47e5-a9a2-adc790f9030d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251', 'volume_name': 'volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580dea52-e575-4c5b-9345-9a3ba45a3be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580dea52-e575-4c5b-9345-9a3ba45a3be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac74e3f4-3512-414e-849d-29326d7ad615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:20 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume 7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251', 'volume_size': 1} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Acquiring lock "cinder-de1b304c-d1dc-4b80-97c5-c38668bba959-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Lock "cinder-de1b304c-d1dc-4b80-97c5-c38668bba959-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Acquiring lock "cinder-quobyte-de1b304c-d1dc-4b80-97c5-c38668bba959" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:20 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc 1G" returned: 0 in 0.746s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Lock "cinder-quobyte-de1b304c-d1dc-4b80-97c5-c38668bba959" acquired by "delete_volume" :: waited 0.081s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:20 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc Nov 06 11:00:20 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc50693d-6bae-420b-a96e-43f2341f0740]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-de1b304c-d1dc-4b80-97c5-c38668bba959 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Flow 'volume_create_manager' (e6ff1d78-590c-4eb5-9923-a523c5adab61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1118f0-feaa-42f8-8272-c45228d2964d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1118f0-feaa-42f8-8272-c45228d2964d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1593563701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2fdb534-447b-46c2-92ac-cff6a0d9adf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b30556654d403ab0e4fbacb56d9db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:21Z,use_quota=True,user_id='c4f640d6535d4d9c808d6e68a374aaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e98959-5a05-4ae7-b82d-1c3d1b146d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e98959-5a05-4ae7-b82d-1c3d1b146d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1edb8a-1e1e-4cd7-ada7-d9b3e727137f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1edb8a-1e1e-4cd7-ada7-d9b3e727137f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2fdb534-447b-46c2-92ac-cff6a0d9adf8', 'volume_name': 'volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcfa8671-0e61-4e2d-a767-49d872ebc19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcfa8671-0e61-4e2d-a767-49d872ebc19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6491b9-c417-4d26-a22e-6237d1e91552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:20 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume d2fdb534-447b-46c2-92ac-cff6a0d9adf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8', 'volume_size': 1} Nov 06 11:00:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:20 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-de1b304c-d1dc-4b80-97c5-c38668bba959 Nov 06 11:00:20 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:21 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc" returned: 0 in 0.564s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:21 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc is being set with open permissions: ugo+rw Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:21 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc Nov 06 11:00:21 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:21 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Flow 'volume_create_manager' (2b361739-7687-4f87-a310-5a44482702b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3078efa3-86b3-4cc4-aeac-1cf2b2433e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-de1b304c-d1dc-4b80-97c5-c38668bba959" returned: 0 in 0.696s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-de1b304c-d1dc-4b80-97c5-c38668bba959 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3078efa3-86b3-4cc4-aeac-1cf2b2433e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1857597806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f770b02-2326-4e02-b328-74ecf7842622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b30556654d403ab0e4fbacb56d9db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:21Z,use_quota=True,user_id='c4f640d6535d4d9c808d6e68a374aaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11afb989-766b-4d22-b466-b1468235b80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11afb989-766b-4d22-b466-b1468235b80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:21 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-de1b304c-d1dc-4b80-97c5-c38668bba959 Nov 06 11:00:21 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce426c0a-6e69-4cf4-b475-b8e90dd00216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce426c0a-6e69-4cf4-b475-b8e90dd00216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f770b02-2326-4e02-b328-74ecf7842622', 'volume_name': 'volume-4f770b02-2326-4e02-b328-74ecf7842622', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63675567-0dcb-465a-9cd1-f6cc552cdf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63675567-0dcb-465a-9cd1-f6cc552cdf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1a992d-f4b3-4ff4-8951-0056f3b278c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:21 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume 4f770b02-2326-4e02-b328-74ecf7842622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f770b02-2326-4e02-b328-74ecf7842622', 'volume_size': 1} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:21 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc" returned: 0 in 0.441s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:21 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.info Nov 06 11:00:21 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:21 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-de1b304c-d1dc-4b80-97c5-c38668bba959" returned: 0 in 0.411s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Flow 'volume_create_manager' (4f910e98-3906-49f6-a032-36faa14f562b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb89f57-7dd2-4432-a665-ab6290de2de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Lock "cinder-quobyte-de1b304c-d1dc-4b80-97c5-c38668bba959" released by "delete_volume" :: held 1.199s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb89f57-7dd2-4432-a665-ab6290de2de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1470158469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bb74c2-780b-437a-bd25-b4e74db9c185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b30556654d403ab0e4fbacb56d9db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:22Z,use_quota=True,user_id='c4f640d6535d4d9c808d6e68a374aaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f87da80-719d-4dd8-8531-2cc249c2ed9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f87da80-719d-4dd8-8531-2cc249c2ed9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe79a2bc-5931-4795-9589-62666b1b0865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe79a2bc-5931-4795-9589-62666b1b0865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4bb74c2-780b-437a-bd25-b4e74db9c185', 'volume_name': 'volume-f4bb74c2-780b-437a-bd25-b4e74db9c185', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d082ca35-f8fc-4355-b003-82ce65eda5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d082ca35-f8fc-4355-b003-82ce65eda5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c69c332-25c5-414a-a4eb-d8986170d27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:21 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume f4bb74c2-780b-437a-bd25-b4e74db9c185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4bb74c2-780b-437a-bd25-b4e74db9c185', 'volume_size': 1} Nov 06 11:00:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Created reservations ['4ef68bb9-96e8-41f1-97e4-fdb58ac4516b', 'ae55b4a1-2473-4a53-8d61-ad5313b4ea83', '20272b1c-bffa-4411-8739-06b92a7e1898', '2681cdcb-0d81-4a37-81df-26c538d9420b'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:22 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.info" returned: 0 in 0.315s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:22 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.info is being set with open permissions: ugo+rw Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:22 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.info Nov 06 11:00:22 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:22 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:22 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:22 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.info" returned: 0 in 0.277s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.077s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.419s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1405397257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9717f66c-23d1-4354-8b77-6eab62343ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b30556654d403ab0e4fbacb56d9db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:20Z,use_quota=True,user_id='c4f640d6535d4d9c808d6e68a374aaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Creating volume 9717f66c-23d1-4354-8b77-6eab62343ba5 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:22 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9717f66c-23d1-4354-8b77-6eab62343ba5 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:22 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.273s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:22 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Deleted volume successfully. Nov 06 11:00:22 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9717f66c-23d1-4354-8b77-6eab62343ba5 1073741824 Nov 06 11:00:22 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:22 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7962e76b-40ab-48e1-9434-a7e44a3e5845 tempest-ProjectMemberTests-348771717 None] Create snapshot completed successfully Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8557d68c-8571-47b0-9a5e-f2531ce189a8 tempest-ProjectReaderTests-540435476 None] Lock "cinder-de1b304c-d1dc-4b80-97c5-c38668bba959-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Lock "cinder-4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-d1cc329d-3811-4723-a35f-e1e03b3307f0" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-d1cc329d-3811-4723-a35f-e1e03b3307f0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Deleting offline snapshot 4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc of volume d1cc329d-3811-4723-a35f-e1e03b3307f0 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] snapshot_file for this snap is: volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78e9819-d5b5-4f67-8a20-4e4bf8b1dd8c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:22 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9717f66c-23d1-4354-8b77-6eab62343ba5 1073741824" returned: 0 in 0.608s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:22 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc Nov 06 11:00:22 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9717f66c-23d1-4354-8b77-6eab62343ba5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:23 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9717f66c-23d1-4354-8b77-6eab62343ba5 Nov 06 11:00:23 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:23 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc" returned: 0 in 0.459s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1cc329d-3811-4723-a35f-e1e03b3307f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:00:23 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9717f66c-23d1-4354-8b77-6eab62343ba5" returned: 0 in 0.348s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.929s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1736876974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b30556654d403ab0e4fbacb56d9db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:20Z,use_quota=True,user_id='c4f640d6535d4d9c808d6e68a374aaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Creating volume 7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:23 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[570281cd-84f8-4289-b9be-50edc38239bb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba12a7a-5d03-45f3-ac1e-37209335ba90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9717f66c-23d1-4354-8b77-6eab62343ba5', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b541376-4945-4a0b-81f0-508a35873415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:23 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251 1073741824 Nov 06 11:00:23 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:23 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume volume-9717f66c-23d1-4354-8b77-6eab62343ba5 (9717f66c-23d1-4354-8b77-6eab62343ba5): created successfully Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b541376-4945-4a0b-81f0-508a35873415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Flow 'volume_create_manager' (5aa1810c-5e43-494d-bb6f-299471ca87f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-c2be4728-7aef-4768-b140-eed0917446a5 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Created volume successfully. Nov 06 11:00:23 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 Nov 06 11:00:23 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:23 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0" returned: 0 in 0.555s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:24 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc Nov 06 11:00:24 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:24 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251 1073741824" returned: 0 in 0.673s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:24 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251 Nov 06 11:00:24 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:24 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc" returned: 0 in 0.472s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:24 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251" returned: 0 in 0.364s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:24 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc Nov 06 11:00:24 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.596s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1593563701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2fdb534-447b-46c2-92ac-cff6a0d9adf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b30556654d403ab0e4fbacb56d9db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:21Z,use_quota=True,user_id='c4f640d6535d4d9c808d6e68a374aaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Creating volume d2fdb534-447b-46c2-92ac-cff6a0d9adf8 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:24 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac74e3f4-3512-414e-849d-29326d7ad615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4797b492-f766-4058-b581-e063ee03d66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:24 devstack sudo[108672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8 1073741824 Nov 06 11:00:24 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:24 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251 (7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251): created successfully Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4797b492-f766-4058-b581-e063ee03d66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Flow 'volume_create_manager' (c864c915-ce63-43c3-a4ba-499c26f48203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:24 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-f632af55-92e0-4eee-95f2-1f4462709d85 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Created volume successfully. Nov 06 11:00:24 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0.4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc" returned: 0 in 0.435s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc" released by "_delete_snapshot" :: held 2.153s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:24 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-d1cc329d-3811-4723-a35f-e1e03b3307f0" released by "delete_snapshot" :: held 2.189s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Created reservations ['b1be1dcb-066d-4d0d-a0e9-f8ee3e31f0a4', '5c2db7f3-5c0d-4b94-a651-655253d5f1d3', 'c00ca19f-9046-430a-b624-c9fe473099b1', '31578a98-c2d6-4cdb-b376-2b7097b085ad'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:25 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Delete snapshot completed successfully. Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b06c5bc1-a004-4cc5-9a50-277f894908d2 tempest-ProjectMemberTests-348771717 None] Lock "cinder-4e4d84d4-7984-41f8-bbc1-6e4facb7a8fc-delete_snapshot" released by "delete_snapshot" :: held 2.447s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:25 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8 1073741824" returned: 0 in 0.706s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:25 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8 Nov 06 11:00:25 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:25 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8" returned: 0 in 0.260s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.968s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1857597806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f770b02-2326-4e02-b328-74ecf7842622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b30556654d403ab0e4fbacb56d9db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:21Z,use_quota=True,user_id='c4f640d6535d4d9c808d6e68a374aaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Creating volume 4f770b02-2326-4e02-b328-74ecf7842622 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:25 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4f770b02-2326-4e02-b328-74ecf7842622 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:25 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4f770b02-2326-4e02-b328-74ecf7842622 1073741824 Nov 06 11:00:25 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6491b9-c417-4d26-a22e-6237d1e91552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0458d8e4-6000-47be-ba92-ece63405ecbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:25 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8 (d2fdb534-447b-46c2-92ac-cff6a0d9adf8): created successfully Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0458d8e4-6000-47be-ba92-ece63405ecbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:25 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Flow 'volume_create_manager' (e6ff1d78-590c-4eb5-9923-a523c5adab61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:25 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5afad0c5-b7e6-4461-9adc-cd97fcd75b22 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Created volume successfully. Nov 06 11:00:26 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4f770b02-2326-4e02-b328-74ecf7842622 1073741824" returned: 0 in 0.483s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-d1cc329d-3811-4723-a35f-e1e03b3307f0-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Lock "cinder-d1cc329d-3811-4723-a35f-e1e03b3307f0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4f770b02-2326-4e02-b328-74ecf7842622 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-d1cc329d-3811-4723-a35f-e1e03b3307f0" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:26 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4f770b02-2326-4e02-b328-74ecf7842622 Nov 06 11:00:26 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-d1cc329d-3811-4723-a35f-e1e03b3307f0" acquired by "delete_volume" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a316f6-c7f4-46d5-91c2-6fe42724898d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:26 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 Nov 06 11:00:26 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:26 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4f770b02-2326-4e02-b328-74ecf7842622" returned: 0 in 0.335s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.466s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1470158469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bb74c2-780b-437a-bd25-b4e74db9c185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b30556654d403ab0e4fbacb56d9db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:22Z,use_quota=True,user_id='c4f640d6535d4d9c808d6e68a374aaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Creating volume f4bb74c2-780b-437a-bd25-b4e74db9c185 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:26 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f4bb74c2-780b-437a-bd25-b4e74db9c185 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1a992d-f4b3-4ff4-8951-0056f3b278c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f770b02-2326-4e02-b328-74ecf7842622', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:26 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f4bb74c2-780b-437a-bd25-b4e74db9c185 1073741824 Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e33a21b-a96a-4c89-b851-59a98a372980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:26 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:26 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume volume-4f770b02-2326-4e02-b328-74ecf7842622 (4f770b02-2326-4e02-b328-74ecf7842622): created successfully Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e33a21b-a96a-4c89-b851-59a98a372980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Flow 'volume_create_manager' (2b361739-7687-4f87-a310-5a44482702b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:26 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5e6b8139-0490-43fc-b2ad-cd58405520d8 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Created volume successfully. Nov 06 11:00:26 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0" returned: 0 in 0.436s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:26 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0 Nov 06 11:00:26 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:26 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d1cc329d-3811-4723-a35f-e1e03b3307f0" returned: 0 in 0.292s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:26 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f4bb74c2-780b-437a-bd25-b4e74db9c185 1073741824" returned: 0 in 0.506s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-d1cc329d-3811-4723-a35f-e1e03b3307f0" released by "delete_volume" :: held 0.819s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f4bb74c2-780b-437a-bd25-b4e74db9c185 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:27 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f4bb74c2-780b-437a-bd25-b4e74db9c185 Nov 06 11:00:27 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Created reservations ['7f27cc63-06b1-47b0-a619-ac3f07b7dcd9', '55ad04b4-b7f0-42ef-8b93-8b619ca357a1', '7dbcca83-085a-4ea4-975e-b43b2aabe97e', '792dbbf6-e97c-4201-b8d4-395feba7dea7'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:27 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:27 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:27 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f4bb74c2-780b-437a-bd25-b4e74db9c185" returned: 0 in 0.284s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c69c332-25c5-414a-a4eb-d8986170d27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4bb74c2-780b-437a-bd25-b4e74db9c185', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0eda84-9499-4682-a334-56ae844db910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:27 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Volume volume-f4bb74c2-780b-437a-bd25-b4e74db9c185 (f4bb74c2-780b-437a-bd25-b4e74db9c185): created successfully Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0eda84-9499-4682-a334-56ae844db910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Flow 'volume_create_manager' (4f910e98-3906-49f6-a032-36faa14f562b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:27 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ee27bb44-3bf1-40b7-8678-a422a56481b6 tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Created volume successfully. Nov 06 11:00:27 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.299s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:27 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Deleted volume successfully. Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-8a50fc24-4d01-49d8-9f1e-f8fe5c2c72f7 tempest-ProjectMemberTests-348771717 None] Lock "cinder-d1cc329d-3811-4723-a35f-e1e03b3307f0-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "cinder-f4bb74c2-780b-437a-bd25-b4e74db9c185-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-f4bb74c2-780b-437a-bd25-b4e74db9c185-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "cinder-quobyte-f4bb74c2-780b-437a-bd25-b4e74db9c185" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-quobyte-f4bb74c2-780b-437a-bd25-b4e74db9c185" acquired by "delete_volume" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58d13e0-0f62-4818-acaf-fa9717614c55]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f4bb74c2-780b-437a-bd25-b4e74db9c185 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (a90bd7fc-3b56-4c52-b1cb-0c3f7bf65f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1eb80bf-de0f-4d2e-8f9e-c564cc9045dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1eb80bf-de0f-4d2e-8f9e-c564cc9045dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123627600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b8e931-f324-4c77-9821-4a78ad379b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:28Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cd2e27-9058-4647-a619-988cd8356fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cd2e27-9058-4647-a619-988cd8356fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192bb290-40d3-4875-9617-79241be21bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192bb290-40d3-4875-9617-79241be21bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b8e931-f324-4c77-9821-4a78ad379b24', 'volume_name': 'volume-e4b8e931-f324-4c77-9821-4a78ad379b24', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cb1f28-2243-45a9-bf47-1ce5af8818f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cb1f28-2243-45a9-bf47-1ce5af8818f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1523ad8a-7132-4163-bada-3160ef050f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:27 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Volume e4b8e931-f324-4c77-9821-4a78ad379b24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b8e931-f324-4c77-9821-4a78ad379b24', 'volume_size': 1} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123627600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b8e931-f324-4c77-9821-4a78ad379b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:28Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Creating volume e4b8e931-f324-4c77-9821-4a78ad379b24 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:27 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f4bb74c2-780b-437a-bd25-b4e74db9c185 Nov 06 11:00:27 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:27 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:27 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24 1073741824 Nov 06 11:00:27 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:28 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f4bb74c2-780b-437a-bd25-b4e74db9c185" returned: 0 in 0.407s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f4bb74c2-780b-437a-bd25-b4e74db9c185 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:28 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f4bb74c2-780b-437a-bd25-b4e74db9c185 Nov 06 11:00:28 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:28 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24 1073741824" returned: 0 in 0.488s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:28 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-f4bb74c2-780b-437a-bd25-b4e74db9c185" returned: 0 in 0.270s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:28 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24 Nov 06 11:00:28 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-quobyte-f4bb74c2-780b-437a-bd25-b4e74db9c185" released by "delete_volume" :: held 0.731s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Created reservations ['55121945-53bf-44ce-a565-8bf06249ebe6', 'f1bc258e-4050-40d5-b93b-43849b708de8', '8c7c4a30-14ef-4ee8-8ee0-d8bc59ec45a7', '5a18a7c4-adeb-406c-adaf-20d5be19e2c0'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:28 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:28 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:28 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24" returned: 0 in 0.305s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1523ad8a-7132-4163-bada-3160ef050f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b8e931-f324-4c77-9821-4a78ad379b24', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8888365a-f53a-4a37-9dd3-e83a8fe138cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:28 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Volume volume-e4b8e931-f324-4c77-9821-4a78ad379b24 (e4b8e931-f324-4c77-9821-4a78ad379b24): created successfully Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8888365a-f53a-4a37-9dd3-e83a8fe138cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (a90bd7fc-3b56-4c52-b1cb-0c3f7bf65f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:28 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-ae893d41-3a84-41ee-8932-5dd7d32fdead tempest-ProjectMemberTests-348771717 None] Created volume successfully. Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "cinder-4f770b02-2326-4e02-b328-74ecf7842622-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-4f770b02-2326-4e02-b328-74ecf7842622-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "cinder-quobyte-4f770b02-2326-4e02-b328-74ecf7842622" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-quobyte-4f770b02-2326-4e02-b328-74ecf7842622" acquired by "delete_volume" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:28 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.329s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:29 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Deleted volume successfully. Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc774618-e6ce-4448-9c1b-dc3c07abaa1e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4f770b02-2326-4e02-b328-74ecf7842622 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-087cf3b3-06af-4ab2-a8d2-6cea52cb364c tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-f4bb74c2-780b-437a-bd25-b4e74db9c185-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:29 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4f770b02-2326-4e02-b328-74ecf7842622 Nov 06 11:00:29 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:29 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4f770b02-2326-4e02-b328-74ecf7842622" returned: 0 in 0.396s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4f770b02-2326-4e02-b328-74ecf7842622 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:29 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4f770b02-2326-4e02-b328-74ecf7842622 Nov 06 11:00:29 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:29 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-4f770b02-2326-4e02-b328-74ecf7842622" returned: 0 in 0.257s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-quobyte-4f770b02-2326-4e02-b328-74ecf7842622" released by "delete_volume" :: held 0.713s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Created reservations ['eb4afa97-ad95-4d8b-be9f-5f307161e840', '91831740-17ad-4c60-8620-3a160d29837b', 'e05490de-ef15-44e5-920d-e8ad4643a795', '9d800fd2-aa5b-4e8e-b247-f5203167827f'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:29 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:29 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:29 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "cinder-d2fdb534-447b-46c2-92ac-cff6a0d9adf8-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-d2fdb534-447b-46c2-92ac-cff6a0d9adf8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:30 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.322s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:30 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Deleted volume successfully. Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] Creating offline snapshot ae665032-ac2e-4ff7-afbc-3c7c0abdc21f of volume e4b8e931-f324-4c77-9821-4a78ad379b24 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2ad29e5b-2c8e-48c8-92cd-123d27c6ff9f tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-4f770b02-2326-4e02-b328-74ecf7842622-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "cinder-quobyte-d2fdb534-447b-46c2-92ac-cff6a0d9adf8" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78a29ab-e962-49b4-b3d9-7abfbbb661a8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-quobyte-d2fdb534-447b-46c2-92ac-cff6a0d9adf8" acquired by "delete_volume" :: waited 0.036s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae26d39-ae1b-4b23-a022-17ba8bb7fcd9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:30 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24 Nov 06 11:00:30 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:30 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8 Nov 06 11:00:30 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:30 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24" returned: 0 in 0.434s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:30 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:30 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f 1G Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8" returned: 0 in 0.400s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:30 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:30 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8 Nov 06 11:00:30 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:30 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-d2fdb534-447b-46c2-92ac-cff6a0d9adf8" returned: 0 in 0.275s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:30 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-quobyte-d2fdb534-447b-46c2-92ac-cff6a0d9adf8" released by "delete_volume" :: held 0.733s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Created reservations ['f4f394fb-3127-419e-b3ce-2737843b67ad', '4b152d8d-da03-4429-893a-0bb21e390d91', '6e8a1e54-dccc-47a9-bd0b-31dbc85e86ab', '6095b197-f2d2-4dcd-bc11-3502c43a1a35'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:31 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f 1G" returned: 0 in 0.505s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b8e931-f324-4c77-9821-4a78ad379b24 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:31 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:31 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:31 devstack sudo[108764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b8e931-f324-4c77-9821-4a78ad379b24 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f Nov 06 11:00:31 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "cinder-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "cinder-quobyte-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-quobyte-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251" acquired by "delete_volume" :: waited 0.027s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f841615-2ad3-4ea2-b45d-09e3605bdd79]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:31 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.345s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:31 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Deleted volume successfully. Nov 06 11:00:31 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b8e931-f324-4c77-9821-4a78ad379b24 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f" returned: 0 in 0.366s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:31 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f is being set with open permissions: ugo+rw Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-71a394af-1149-44bc-872e-4b4282d50d5b tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-d2fdb534-447b-46c2-92ac-cff6a0d9adf8-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:31 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f Nov 06 11:00:31 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:31 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251 Nov 06 11:00:31 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:31 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f" returned: 0 in 0.303s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:31 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.info Nov 06 11:00:31 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:31 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251" returned: 0 in 0.430s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:31 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:31 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251 Nov 06 11:00:31 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:32 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.info" returned: 0 in 0.289s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:32 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.info is being set with open permissions: ugo+rw Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:32 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251" returned: 0 in 0.286s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:32 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.info Nov 06 11:00:32 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-quobyte-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251" released by "delete_volume" :: held 0.789s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Created reservations ['884acb1a-0450-4c2b-bd2a-b3b02aa081a9', 'f5694612-076a-4eb6-8d3d-b18ec645b48c', '6bb335f1-920f-4fb2-b8c4-0df276455a75', '5bb02334-dfbf-4ee3-bcfe-aa33fbd59ee2'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:32 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:32 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:32 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.info" returned: 0 in 0.297s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "cinder-9717f66c-23d1-4354-8b77-6eab62343ba5-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:32 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-88f7dc6a-ea1f-4f08-b4db-5d9a6e28dc1d tempest-ProjectMemberTests-348771717 None] Create snapshot completed successfully Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-9717f66c-23d1-4354-8b77-6eab62343ba5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "cinder-quobyte-9717f66c-23d1-4354-8b77-6eab62343ba5" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-quobyte-9717f66c-23d1-4354-8b77-6eab62343ba5" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:32 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.313s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:32 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Deleted volume successfully. Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8c378d-c546-47d5-9715-495071e020d3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9717f66c-23d1-4354-8b77-6eab62343ba5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:32 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-eda9b18f-682f-4353-ba46-33ff7ab2148e tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-7c2f328b-2f7c-46d1-b0c9-6d3f1f2ee251-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:32 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9717f66c-23d1-4354-8b77-6eab62343ba5 Nov 06 11:00:32 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:33 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9717f66c-23d1-4354-8b77-6eab62343ba5" returned: 0 in 0.396s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9717f66c-23d1-4354-8b77-6eab62343ba5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:33 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9717f66c-23d1-4354-8b77-6eab62343ba5 Nov 06 11:00:33 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-ae665032-ac2e-4ff7-afbc-3c7c0abdc21f-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Lock "cinder-ae665032-ac2e-4ff7-afbc-3c7c0abdc21f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-e4b8e931-f324-4c77-9821-4a78ad379b24" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-e4b8e931-f324-4c77-9821-4a78ad379b24" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-ae665032-ac2e-4ff7-afbc-3c7c0abdc21f" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-ae665032-ac2e-4ff7-afbc-3c7c0abdc21f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Deleting offline snapshot ae665032-ac2e-4ff7-afbc-3c7c0abdc21f of volume e4b8e931-f324-4c77-9821-4a78ad379b24 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:00:33 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] snapshot_file for this snap is: volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9717f66c-23d1-4354-8b77-6eab62343ba5" returned: 0 in 0.304s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[479449d9-8f66-4e97-852b-18b8b1eba8f7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-quobyte-9717f66c-23d1-4354-8b77-6eab62343ba5" released by "delete_volume" :: held 0.754s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Created reservations ['dd95a8bb-2a97-49b4-af62-2968b66a41af', '4145bddd-a181-4bfa-a045-d506b72e5c43', '0939cb9a-d3ff-457c-ad7e-fa7415d6feee', '773668bc-cf03-483a-a7ce-4ec349466f19'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:33 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f Nov 06 11:00:33 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:33 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:33 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "cinder-fd690a12-957c-4e61-a0a9-d3105183fb4f-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-fd690a12-957c-4e61-a0a9-d3105183fb4f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:33 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f" returned: 0 in 0.451s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b8e931-f324-4c77-9821-4a78ad379b24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:00:33 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "cinder-quobyte-fd690a12-957c-4e61-a0a9-d3105183fb4f" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.341s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:33 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Deleted volume successfully. Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ebd3e1-51ae-4c19-a424-1e0bb7038c54]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-quobyte-fd690a12-957c-4e61-a0a9-d3105183fb4f" acquired by "delete_volume" :: waited 0.046s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2e58e28e-db2e-491c-9e4a-e4023b9d3aea tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-9717f66c-23d1-4354-8b77-6eab62343ba5-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[686411e2-99c3-49ee-bdb5-906c31efde45]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:33 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fd690a12-957c-4e61-a0a9-d3105183fb4f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:34 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24 Nov 06 11:00:34 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:34 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fd690a12-957c-4e61-a0a9-d3105183fb4f Nov 06 11:00:34 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:34 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24" returned: 0 in 0.433s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:34 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fd690a12-957c-4e61-a0a9-d3105183fb4f" returned: 0 in 0.400s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fd690a12-957c-4e61-a0a9-d3105183fb4f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:34 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f Nov 06 11:00:34 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:34 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fd690a12-957c-4e61-a0a9-d3105183fb4f Nov 06 11:00:34 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:34 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-fd690a12-957c-4e61-a0a9-d3105183fb4f" returned: 0 in 0.284s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:34 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-quobyte-fd690a12-957c-4e61-a0a9-d3105183fb4f" released by "delete_volume" :: held 0.737s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:34 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Created reservations ['96cfee92-8c8b-44f0-8f69-583dc8f1889d', 'cae793ba-fd35-42fd-af8b-46eed3d54d12', '5832e93e-c581-408c-85e0-42166b0f3f1c', '3896773a-6b44-4bea-a31b-6f3aaba6e755'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:34 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f" returned: 0 in 0.402s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:34 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f Nov 06 11:00:34 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:34 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:34 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:34 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:34 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:35 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24.ae665032-ac2e-4ff7-afbc-3c7c0abdc21f" returned: 0 in 0.292s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-ae665032-ac2e-4ff7-afbc-3c7c0abdc21f" released by "_delete_snapshot" :: held 1.727s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-e4b8e931-f324-4c77-9821-4a78ad379b24" released by "delete_snapshot" :: held 1.766s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:35 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.336s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:35 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:35 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Deleted volume successfully. Nov 06 11:00:35 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Created reservations ['4f12cf43-1db5-4b12-a3ca-e37079e8e34a', '5904cda0-b72a-4ed3-b885-8c09a959e4f0', '8e93cbdc-9060-434a-b82e-3cad2ad893ad', 'aba7c1e2-ad8c-4c50-9e8d-2c76e9fd6945'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5d793034-f3f1-4999-8d28-b29a22f9871d tempest-CreateVolumesFromSourceVolumeTest-643442944 None] Lock "cinder-fd690a12-957c-4e61-a0a9-d3105183fb4f-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:35 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Delete snapshot completed successfully. Nov 06 11:00:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7ac6c94b-6c46-41fc-8642-9d0528157f82 tempest-ProjectMemberTests-348771717 None] Lock "cinder-ae665032-ac2e-4ff7-afbc-3c7c0abdc21f-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-e4b8e931-f324-4c77-9821-4a78ad379b24-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Lock "cinder-e4b8e931-f324-4c77-9821-4a78ad379b24-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-e4b8e931-f324-4c77-9821-4a78ad379b24" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:35 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-e4b8e931-f324-4c77-9821-4a78ad379b24" acquired by "delete_volume" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:35 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa683464-33d7-4bad-83df-14a0f2d7e566]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:35 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:35 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24 Nov 06 11:00:35 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:36 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24" returned: 0 in 0.407s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:36 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24 Nov 06 11:00:36 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:36 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:36 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:36 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-e4b8e931-f324-4c77-9821-4a78ad379b24" returned: 0 in 0.302s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-e4b8e931-f324-4c77-9821-4a78ad379b24" released by "delete_volume" :: held 0.815s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Created reservations ['fe95c4b3-1be3-4c8b-a2cc-8fd0fdf71e6b', 'e2074f39-dc67-4431-bbe7-56e029708b52', '86dbed1f-dfbc-4ab4-900a-f1723fc2b5d0', '58ff7c51-cddc-42f6-8b32-f60093a4658f'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:36 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.359s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 29 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:36 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:36 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:37 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.397s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:37 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Deleted volume successfully. Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-856b26b5-0dbc-46fa-811c-c9002bf12e18 tempest-ProjectMemberTests-348771717 None] Lock "cinder-e4b8e931-f324-4c77-9821-4a78ad379b24-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (a060bf12-aa6c-4653-888d-6f1c21086690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4714ef44-9be2-4639-87c9-5c219463905b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4714ef44-9be2-4639-87c9-5c219463905b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1416554498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe2e152-6201-431e-9bb0-43a022f7a441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:37Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec7f9a4-712f-4c09-8189-0d920e74d67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec7f9a4-712f-4c09-8189-0d920e74d67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e3b22b-0249-410b-8df0-0fddd4fc8be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e3b22b-0249-410b-8df0-0fddd4fc8be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe2e152-6201-431e-9bb0-43a022f7a441', 'volume_name': 'volume-8fe2e152-6201-431e-9bb0-43a022f7a441', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d393d77-59a0-4a9c-8ab7-46033ccff966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d393d77-59a0-4a9c-8ab7-46033ccff966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415700e0-d4d8-4d0f-8617-34b01eaee6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:37 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Volume 8fe2e152-6201-431e-9bb0-43a022f7a441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe2e152-6201-431e-9bb0-43a022f7a441', 'volume_size': 1} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1416554498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe2e152-6201-431e-9bb0-43a022f7a441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:37Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Creating volume 8fe2e152-6201-431e-9bb0-43a022f7a441 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:37 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:37 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441 1073741824 Nov 06 11:00:37 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:37 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441 1073741824" returned: 0 in 0.495s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:37 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:37 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441 Nov 06 11:00:37 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:38 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441" returned: 0 in 0.254s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:38 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:38 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415700e0-d4d8-4d0f-8617-34b01eaee6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe2e152-6201-431e-9bb0-43a022f7a441', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45cffd75-f540-4cfe-a344-3663b0c162d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:38 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Volume volume-8fe2e152-6201-431e-9bb0-43a022f7a441 (8fe2e152-6201-431e-9bb0-43a022f7a441): created successfully Nov 06 11:00:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45cffd75-f540-4cfe-a344-3663b0c162d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:38 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (a060bf12-aa6c-4653-888d-6f1c21086690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:38 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-018ee5bf-2918-443b-9d03-d1a883c0b9da tempest-ProjectMemberTests-348771717 None] Created volume successfully. Nov 06 11:00:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:39 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] Creating offline snapshot 92a3a93f-4b19-46ec-893f-e20f6e53445e of volume 8fe2e152-6201-431e-9bb0-43a022f7a441 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:00:39 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3938c94-9596-418a-94cf-1a2067985e5a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:39 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441 Nov 06 11:00:39 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:39 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441" returned: 0 in 0.388s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:39 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:39 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e 1G Nov 06 11:00:39 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:40 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e 1G" returned: 0 in 0.442s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fe2e152-6201-431e-9bb0-43a022f7a441 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:40 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fe2e152-6201-431e-9bb0-43a022f7a441 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e Nov 06 11:00:40 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:40 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fe2e152-6201-431e-9bb0-43a022f7a441 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e" returned: 0 in 0.323s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:40 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e is being set with open permissions: ugo+rw Nov 06 11:00:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:40 devstack sudo[108874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e Nov 06 11:00:40 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:40 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e" returned: 0 in 0.278s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:40 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:40 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.info Nov 06 11:00:40 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:41 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.info" returned: 0 in 0.269s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:41 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.info is being set with open permissions: ugo+rw Nov 06 11:00:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:41 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.info Nov 06 11:00:41 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:41 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.info" returned: 0 in 0.252s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:41 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:41 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d5d4617c-e0b4-4215-a90a-4bdebe8430e7 tempest-ProjectMemberTests-348771717 None] Create snapshot completed successfully Nov 06 11:00:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-92a3a93f-4b19-46ec-893f-e20f6e53445e-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Lock "cinder-92a3a93f-4b19-46ec-893f-e20f6e53445e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-8fe2e152-6201-431e-9bb0-43a022f7a441" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-8fe2e152-6201-431e-9bb0-43a022f7a441" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-92a3a93f-4b19-46ec-893f-e20f6e53445e" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:42 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-92a3a93f-4b19-46ec-893f-e20f6e53445e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Deleting offline snapshot 92a3a93f-4b19-46ec-893f-e20f6e53445e of volume 8fe2e152-6201-431e-9bb0-43a022f7a441 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:00:42 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] snapshot_file for this snap is: volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:00:42 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[566ca9f7-46b2-4a4a-a613-868af62e2e33]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:42 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:42 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e Nov 06 11:00:42 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:43 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e" returned: 0 in 0.389s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fe2e152-6201-431e-9bb0-43a022f7a441(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d9b15b-3a00-4269-891b-1690ca7415b8]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:43 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441 Nov 06 11:00:43 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Flow 'volume_create_manager' (b28d2e27-a3b1-449d-9275-c598dbc6a490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10e33e5-0be4-4cd0-9a3f-74bda2663007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10e33e5-0be4-4cd0-9a3f-74bda2663007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1942559756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67572a8f-bdf5-4ff9-8515-0c74b19b7041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b416b6708b74e878636549515cfd924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:43Z,use_quota=True,user_id='55e70369bf9e4323a22d1ab81d3cc87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad21b5ef-7eda-49ee-ac33-0c4ac3fabee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad21b5ef-7eda-49ee-ac33-0c4ac3fabee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f7655aa-87d1-4ce8-a40a-de923d936e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f7655aa-87d1-4ce8-a40a-de923d936e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67572a8f-bdf5-4ff9-8515-0c74b19b7041', 'volume_name': 'volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d23fae1-64b1-4b72-b1bd-90b3501c0db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d23fae1-64b1-4b72-b1bd-90b3501c0db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af660fe8-b4f1-4615-a816-e86cbec78f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:43 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Volume 67572a8f-bdf5-4ff9-8515-0c74b19b7041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041', 'volume_size': 1} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1942559756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67572a8f-bdf5-4ff9-8515-0c74b19b7041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b416b6708b74e878636549515cfd924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:43Z,use_quota=True,user_id='55e70369bf9e4323a22d1ab81d3cc87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Creating volume 67572a8f-bdf5-4ff9-8515-0c74b19b7041 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:43 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:43 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441" returned: 0 in 0.407s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:43 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 1073741824 Nov 06 11:00:43 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:43 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e Nov 06 11:00:43 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:43 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e" returned: 0 in 0.348s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:43 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e Nov 06 11:00:43 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:43 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 1073741824" returned: 0 in 0.444s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:43 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:44 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 Nov 06 11:00:44 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:44 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441.92a3a93f-4b19-46ec-893f-e20f6e53445e" returned: 0 in 0.259s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-92a3a93f-4b19-46ec-893f-e20f6e53445e" released by "_delete_snapshot" :: held 1.510s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-8fe2e152-6201-431e-9bb0-43a022f7a441" released by "delete_snapshot" :: held 1.533s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Created reservations ['b558d80a-f4fb-4002-9732-da68700421fc', '3cf8a7e0-0b7d-4be4-a23c-4434cbe0f8ad', 'b9b79bbc-5b02-4ad2-9332-a60e54e6f3e6', '1761ebed-bc72-467a-b94c-087e69ea51de'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:44 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041" returned: 0 in 0.268s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af660fe8-b4f1-4615-a816-e86cbec78f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa4d3ec-662c-4361-8c2b-05dd3a26e6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:44 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Volume volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 (67572a8f-bdf5-4ff9-8515-0c74b19b7041): created successfully Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa4d3ec-662c-4361-8c2b-05dd3a26e6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Flow 'volume_create_manager' (b28d2e27-a3b1-449d-9275-c598dbc6a490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:44 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-1d35636a-d09b-4cab-b629-7c118df9e774 tempest-ProjectReaderTests-1799534772 None] Created volume successfully. Nov 06 11:00:44 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Delete snapshot completed successfully. Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5ae9ad21-0410-45e1-93f7-e5878be7dea6 tempest-ProjectMemberTests-348771717 None] Lock "cinder-92a3a93f-4b19-46ec-893f-e20f6e53445e-delete_snapshot" released by "delete_snapshot" :: held 1.713s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] Creating offline snapshot 2b6bec12-b905-4b23-b1cb-7c04edb28143 of volume 67572a8f-bdf5-4ff9-8515-0c74b19b7041 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd767ccc-a3a0-4086-9865-9b2cd5d909ec]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:44 devstack sudo[108914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 Nov 06 11:00:44 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-8fe2e152-6201-431e-9bb0-43a022f7a441-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Lock "cinder-8fe2e152-6201-431e-9bb0-43a022f7a441-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-8fe2e152-6201-431e-9bb0-43a022f7a441" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-8fe2e152-6201-431e-9bb0-43a022f7a441" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed40ec82-be73-4b95-9003-850aa283bbb1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:44 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:45 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441 Nov 06 11:00:45 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:45 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041" returned: 0 in 0.378s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:45 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143 1G Nov 06 11:00:45 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:45 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441" returned: 0 in 0.369s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:45 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441 Nov 06 11:00:45 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:45 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143 1G" returned: 0 in 0.419s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:45 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143 Nov 06 11:00:45 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:45 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-8fe2e152-6201-431e-9bb0-43a022f7a441" returned: 0 in 0.279s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-8fe2e152-6201-431e-9bb0-43a022f7a441" released by "delete_volume" :: held 0.715s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Created reservations ['4857ee2b-4764-46a0-b5fe-8377eb09a362', '7664f513-943a-4e76-9ecf-73effc7aff2e', '40e09932-a89f-4f79-8ee6-a4158014bca8', 'c0678353-4bbb-4bfa-bfc7-e01bfd8f886d'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:45 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:45 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:45 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143" returned: 0 in 0.328s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:45 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143 is being set with open permissions: ugo+rw Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:45 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143 Nov 06 11:00:45 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:45 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.260s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:45 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Deleted volume successfully. Nov 06 11:00:45 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-7ca52b5e-9678-4eca-9ee6-6f5c6515d26b tempest-ProjectMemberTests-348771717 None] Lock "cinder-8fe2e152-6201-431e-9bb0-43a022f7a441-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:46 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143" returned: 0 in 0.262s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:46 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.info Nov 06 11:00:46 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:46 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.info" returned: 0 in 0.286s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:46 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.info is being set with open permissions: ugo+rw Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:46 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.info Nov 06 11:00:46 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (6ea0839b-e210-4712-a905-facabaa03913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0db70f-5884-47ed-85a6-1e1054fe62d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0db70f-5884-47ed-85a6-1e1054fe62d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637092855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f93960-f38c-4e99-8f46-ff0399578391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:46Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874929da-8201-4318-8a61-e9b1679df17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874929da-8201-4318-8a61-e9b1679df17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c07e8f3-0e0e-4491-aa1b-48e3308cb172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c07e8f3-0e0e-4491-aa1b-48e3308cb172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7f93960-f38c-4e99-8f46-ff0399578391', 'volume_name': 'volume-a7f93960-f38c-4e99-8f46-ff0399578391', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a098602f-dfcc-4879-b5e3-801a17738332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a098602f-dfcc-4879-b5e3-801a17738332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5336e6c0-36b1-4176-aaee-0da8d99f3fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:46 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Volume a7f93960-f38c-4e99-8f46-ff0399578391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7f93960-f38c-4e99-8f46-ff0399578391', 'volume_size': 1} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:46 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.info" returned: 0 in 0.257s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.149s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637092855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f93960-f38c-4e99-8f46-ff0399578391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:46Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Creating volume a7f93960-f38c-4e99-8f46-ff0399578391 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:46 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:46 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:46 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391 1073741824 Nov 06 11:00:46 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:46 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-08dcb2ed-3e04-451d-aba4-d93d0d7bb0c8 tempest-ProjectReaderTests-1799534772 None] Create snapshot completed successfully Nov 06 11:00:47 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391 1073741824" returned: 0 in 0.414s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:47 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391 Nov 06 11:00:47 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:47 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391" returned: 0 in 0.248s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5336e6c0-36b1-4176-aaee-0da8d99f3fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7f93960-f38c-4e99-8f46-ff0399578391', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9a7576-0ec3-48c9-830c-b3c2aa64b8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:47 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Volume volume-a7f93960-f38c-4e99-8f46-ff0399578391 (a7f93960-f38c-4e99-8f46-ff0399578391): created successfully Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9a7576-0ec3-48c9-830c-b3c2aa64b8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (6ea0839b-e210-4712-a905-facabaa03913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:47 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-df7e6bb8-ae70-41bf-b3e7-5b3bbe57e520 tempest-ProjectMemberTests-348771717 None] Created volume successfully. Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-2b6bec12-b905-4b23-b1cb-7c04edb28143-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-2b6bec12-b905-4b23-b1cb-7c04edb28143-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-quobyte-67572a8f-bdf5-4ff9-8515-0c74b19b7041" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-67572a8f-bdf5-4ff9-8515-0c74b19b7041" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-quobyte-2b6bec12-b905-4b23-b1cb-7c04edb28143" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-2b6bec12-b905-4b23-b1cb-7c04edb28143" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Deleting offline snapshot 2b6bec12-b905-4b23-b1cb-7c04edb28143 of volume 67572a8f-bdf5-4ff9-8515-0c74b19b7041 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] snapshot_file for this snap is: volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14a3b75-75f2-4aa9-984b-c72b2b944925]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:47 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:48 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143 Nov 06 11:00:48 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:48 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143" returned: 0 in 0.352s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:00:48 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7671c6bd-e3d1-4020-82b9-2e4d8fc018b2]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:48 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 Nov 06 11:00:48 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:48 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] Creating offline snapshot 86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 of volume a7f93960-f38c-4e99-8f46-ff0399578391 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:00:48 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ad33a5-9880-43dd-a8c4-7289bc4c074e]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:48 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041" returned: 0 in 0.380s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:48 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:48 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143 Nov 06 11:00:48 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:48 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391 Nov 06 11:00:48 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:49 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143" returned: 0 in 0.352s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:49 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391" returned: 0 in 0.387s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:49 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143 Nov 06 11:00:49 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:49 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 1G Nov 06 11:00:49 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:49 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041.2b6bec12-b905-4b23-b1cb-7c04edb28143" returned: 0 in 0.249s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-2b6bec12-b905-4b23-b1cb-7c04edb28143" released by "_delete_snapshot" :: held 1.428s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-67572a8f-bdf5-4ff9-8515-0c74b19b7041" released by "delete_snapshot" :: held 1.448s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:49 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Created reservations ['2459c60e-8d65-45a8-8a12-0cdfc49cd0c5', 'd376d7d8-ba80-4749-a39b-06c9ac5cdd57', 'a91db7d3-6991-4c4e-bbc8-fdfcd78c35fd', '7405d09a-8ed5-4acf-9582-a7a9d0952d5c'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:49 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Delete snapshot completed successfully. Nov 06 11:00:49 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-503520bd-95be-4a3f-8a52-5732f123caf4 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-2b6bec12-b905-4b23-b1cb-7c04edb28143-delete_snapshot" released by "delete_snapshot" :: held 1.583s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:49 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 1G" returned: 0 in 0.429s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f93960-f38c-4e99-8f46-ff0399578391 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:49 devstack sudo[108989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f93960-f38c-4e99-8f46-ff0399578391 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 Nov 06 11:00:49 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:49 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f93960-f38c-4e99-8f46-ff0399578391 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418" returned: 0 in 0.290s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:49 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 is being set with open permissions: ugo+rw Nov 06 11:00:49 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:49 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 Nov 06 11:00:49 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-67572a8f-bdf5-4ff9-8515-0c74b19b7041-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:50 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418" returned: 0 in 0.251s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-67572a8f-bdf5-4ff9-8515-0c74b19b7041-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:50 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.info Nov 06 11:00:50 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-quobyte-67572a8f-bdf5-4ff9-8515-0c74b19b7041" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-67572a8f-bdf5-4ff9-8515-0c74b19b7041" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afa3d90-5211-492c-bcfc-71baaa660ea3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:50 devstack sudo[108999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 Nov 06 11:00:50 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:50 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.info" returned: 0 in 0.267s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:50 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.info is being set with open permissions: ugo+rw Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:50 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.info Nov 06 11:00:50 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:50 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041" returned: 0 in 0.379s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:50 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041 Nov 06 11:00:50 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:50 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.info" returned: 0 in 0.260s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:50 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-aba50cdf-f7ee-4f53-b351-4e80636f42dc tempest-ProjectMemberTests-348771717 None] Create snapshot completed successfully Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-86e2f975-6ee9-4ff4-8621-ce8d2dbdd418-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Lock "cinder-86e2f975-6ee9-4ff4-8621-ce8d2dbdd418-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-a7f93960-f38c-4e99-8f46-ff0399578391" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:50 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-67572a8f-bdf5-4ff9-8515-0c74b19b7041" returned: 0 in 0.271s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-67572a8f-bdf5-4ff9-8515-0c74b19b7041" released by "delete_volume" :: held 0.714s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-a7f93960-f38c-4e99-8f46-ff0399578391" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-86e2f975-6ee9-4ff4-8621-ce8d2dbdd418" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-86e2f975-6ee9-4ff4-8621-ce8d2dbdd418" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Deleting offline snapshot 86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 of volume a7f93960-f38c-4e99-8f46-ff0399578391 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] snapshot_file for this snap is: volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7840a1f0-432e-49c0-acc8-89be5fbc5777]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Created reservations ['391021ef-66cd-48fd-bc26-8e188f7d6075', '604329d0-764c-4ed8-b24e-ea063a947966', '1b7d619b-54e8-4ea5-8956-7c1be64550bb', '710dcf69-d7da-49ce-828f-69a9228ed2f6'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:51 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 Nov 06 11:00:51 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:51 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:51 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:51 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.262s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:51 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Deleted volume successfully. Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1d3c921b-7bb9-498d-8771-b0e59c327801 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-67572a8f-bdf5-4ff9-8515-0c74b19b7041-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:51 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418" returned: 0 in 0.429s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7f93960-f38c-4e99-8f46-ff0399578391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8ce0f5-84d0-461c-ac0a-8432e438b670]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:51 devstack sudo[109019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391 Nov 06 11:00:51 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Flow 'volume_create_manager' (d1249835-786a-49ec-af8a-020578105286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab58e9b-6d24-4374-8018-03230bd95c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab58e9b-6d24-4374-8018-03230bd95c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1285088449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01af8d46-9f22-474c-bebb-4f6e6a93d29b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b416b6708b74e878636549515cfd924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:52Z,use_quota=True,user_id='55e70369bf9e4323a22d1ab81d3cc87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184ff031-d48c-493f-99fd-a02b838db63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184ff031-d48c-493f-99fd-a02b838db63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0dc3c8-4ae3-4910-a558-8559fbfe1324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0dc3c8-4ae3-4910-a558-8559fbfe1324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01af8d46-9f22-474c-bebb-4f6e6a93d29b', 'volume_name': 'volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e15d7a-f672-4120-9c6f-594d7e73e330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e15d7a-f672-4120-9c6f-594d7e73e330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932721b5-9f4c-463c-91c4-0ef3d66fde2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:51 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Volume 01af8d46-9f22-474c-bebb-4f6e6a93d29b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b', 'volume_size': 1} Nov 06 11:00:51 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1285088449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01af8d46-9f22-474c-bebb-4f6e6a93d29b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b416b6708b74e878636549515cfd924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:52Z,use_quota=True,user_id='55e70369bf9e4323a22d1ab81d3cc87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Creating volume 01af8d46-9f22-474c-bebb-4f6e6a93d29b {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:51 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391" returned: 0 in 0.396s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:51 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b 1073741824 Nov 06 11:00:51 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:51 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 Nov 06 11:00:51 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:52 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418" returned: 0 in 0.348s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:52 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418 Nov 06 11:00:52 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:52 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b 1073741824" returned: 0 in 0.443s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:52 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b Nov 06 11:00:52 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:52 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391.86e2f975-6ee9-4ff4-8621-ce8d2dbdd418" returned: 0 in 0.255s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-86e2f975-6ee9-4ff4-8621-ce8d2dbdd418" released by "_delete_snapshot" :: held 1.536s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-a7f93960-f38c-4e99-8f46-ff0399578391" released by "delete_snapshot" :: held 1.560s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Created reservations ['0d36e4fe-9de6-4b08-9c88-32a77f4cabeb', '35586bc9-92aa-47f8-9e41-205a28671c48', '9c3d98c1-df91-4c84-8bd3-03c88bfaee33', '21e3cb62-7425-44f2-a30e-0517fad3d55d'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:52 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b" returned: 0 in 0.265s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932721b5-9f4c-463c-91c4-0ef3d66fde2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe97afd-afeb-48e1-b5bc-22855d21ecaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:52 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Volume volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b (01af8d46-9f22-474c-bebb-4f6e6a93d29b): created successfully Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe97afd-afeb-48e1-b5bc-22855d21ecaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Flow 'volume_create_manager' (d1249835-786a-49ec-af8a-020578105286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:52 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Delete snapshot completed successfully. Nov 06 11:00:52 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5f2c71c4-3bc0-487b-8816-551928833c0e tempest-ProjectReaderTests-1799534772 None] Created volume successfully. Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-3138fc68-8da7-424c-b021-e647d256c4eb tempest-ProjectMemberTests-348771717 None] Lock "cinder-86e2f975-6ee9-4ff4-8621-ce8d2dbdd418-delete_snapshot" released by "delete_snapshot" :: held 1.745s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] Creating offline snapshot bb12d1fc-10fa-4a12-8197-d33c4b7974c9 of volume 01af8d46-9f22-474c-bebb-4f6e6a93d29b {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7991eaf-4729-4751-beb6-8382baa0d7a3]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:52 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b Nov 06 11:00:52 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-a7f93960-f38c-4e99-8f46-ff0399578391-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:52 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Lock "cinder-a7f93960-f38c-4e99-8f46-ff0399578391-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-a7f93960-f38c-4e99-8f46-ff0399578391" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-a7f93960-f38c-4e99-8f46-ff0399578391" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2690170-5d24-4a50-895a-0853189aa2f7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:53 devstack sudo[109043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391 Nov 06 11:00:53 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:53 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b" returned: 0 in 0.376s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:53 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9 1G Nov 06 11:00:53 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:53 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391" returned: 0 in 0.371s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:53 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391 Nov 06 11:00:53 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:53 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9 1G" returned: 0 in 0.440s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:53 devstack sudo[109059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9 Nov 06 11:00:53 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:53 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a7f93960-f38c-4e99-8f46-ff0399578391" returned: 0 in 0.286s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-a7f93960-f38c-4e99-8f46-ff0399578391" released by "delete_volume" :: held 0.722s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Created reservations ['5d73d616-77a5-4578-aeb7-741c303472b4', '6a0ba5ff-91fb-4b82-a89b-11e09ae2e9a8', 'ce1f3ea8-45b1-4161-98be-657f57fc5888', '759d3d30-4bd0-4f2d-b61a-fe2951c032ff'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:53 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:53 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:53 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9" returned: 0 in 0.332s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:53 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9 is being set with open permissions: ugo+rw Nov 06 11:00:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:54 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9 Nov 06 11:00:54 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:54 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.260s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:54 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Deleted volume successfully. Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-4c7c81d0-5398-449f-bb44-2e7263ff629b tempest-ProjectMemberTests-348771717 None] Lock "cinder-a7f93960-f38c-4e99-8f46-ff0399578391-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:54 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9" returned: 0 in 0.289s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:54 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.info Nov 06 11:00:54 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:54 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.info" returned: 0 in 0.286s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:54 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.info is being set with open permissions: ugo+rw Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:54 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.info Nov 06 11:00:54 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (c2034402-0574-4ec0-9048-f77a8ea09adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1321555-e2e7-44c6-b6cd-cf6e3004799e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1321555-e2e7-44c6-b6cd-cf6e3004799e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-372799248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b028f87-2057-432b-9402-422caed8e95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:55Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b8edc6-51f6-41ce-862b-07f0a88f1995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b8edc6-51f6-41ce-862b-07f0a88f1995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8779f4fe-d116-4313-872f-a8eabaeecc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8779f4fe-d116-4313-872f-a8eabaeecc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b028f87-2057-432b-9402-422caed8e95c', 'volume_name': 'volume-5b028f87-2057-432b-9402-422caed8e95c', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0495d3-fdf9-439a-bfd8-2e1a67bf2127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0495d3-fdf9-439a-bfd8-2e1a67bf2127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd37cf43-e540-4ddb-a1a7-ca8462c887eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:54 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Volume 5b028f87-2057-432b-9402-422caed8e95c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b028f87-2057-432b-9402-422caed8e95c', 'volume_size': 1} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:54 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.info" returned: 0 in 0.248s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.155s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-372799248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b028f87-2057-432b-9402-422caed8e95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9533c28a65345c397b388c921fb2ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:00:55Z,use_quota=True,user_id='654ea27ea6b945139585b136937685c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Creating volume 5b028f87-2057-432b-9402-422caed8e95c {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:54 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:54 devstack sudo[109077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c 1073741824 Nov 06 11:00:54 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:54 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-0e1eb0a7-6841-4385-8e84-8f75c73dddae tempest-ProjectReaderTests-1799534772 None] Create snapshot completed successfully Nov 06 11:00:55 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c 1073741824" returned: 0 in 0.424s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:55 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c Nov 06 11:00:55 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:55 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c" returned: 0 in 0.247s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:00:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd37cf43-e540-4ddb-a1a7-ca8462c887eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b028f87-2057-432b-9402-422caed8e95c', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c759db-a92c-4244-9d40-c4f1c3131a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:55 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Volume volume-5b028f87-2057-432b-9402-422caed8e95c (5b028f87-2057-432b-9402-422caed8e95c): created successfully Nov 06 11:00:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c759db-a92c-4244-9d40-c4f1c3131a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:55 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Flow 'volume_create_manager' (c2034402-0574-4ec0-9048-f77a8ea09adf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:55 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-6f758a93-0190-49d5-865b-cab06acb9e18 tempest-ProjectMemberTests-348771717 None] Created volume successfully. Nov 06 11:00:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-bb12d1fc-10fa-4a12-8197-d33c4b7974c9-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-bb12d1fc-10fa-4a12-8197-d33c4b7974c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-quobyte-01af8d46-9f22-474c-bebb-4f6e6a93d29b" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-01af8d46-9f22-474c-bebb-4f6e6a93d29b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-quobyte-bb12d1fc-10fa-4a12-8197-d33c4b7974c9" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:55 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-bb12d1fc-10fa-4a12-8197-d33c4b7974c9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Deleting offline snapshot bb12d1fc-10fa-4a12-8197-d33c4b7974c9 of volume 01af8d46-9f22-474c-bebb-4f6e6a93d29b {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:00:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] snapshot_file for this snap is: volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:00:56 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[97708bef-0b23-4899-99d2-049e9e281105]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:56 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9 Nov 06 11:00:56 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:56 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9" returned: 0 in 0.370s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:00:56 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee11c45b-0ba7-4ed8-be9b-ab0acd3884b1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:56 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b Nov 06 11:00:56 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:56 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:56 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] Creating offline snapshot c5ae03c2-6842-4aa0-9c27-3aaf8f847447 of volume 5b028f87-2057-432b-9402-422caed8e95c {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:00:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b" returned: 0 in 0.396s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:56 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[e660e6c5-cbc8-4b29-ab8c-b257c7d786ed]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:56 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:56 devstack sudo[109097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9 Nov 06 11:00:56 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:56 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c Nov 06 11:00:56 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:57 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9" returned: 0 in 0.354s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:57 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9 Nov 06 11:00:57 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:57 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c" returned: 0 in 0.428s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:57 devstack sudo[109110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447 1G Nov 06 11:00:57 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:57 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b.bb12d1fc-10fa-4a12-8197-d33c4b7974c9" returned: 0 in 0.263s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:57 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-bb12d1fc-10fa-4a12-8197-d33c4b7974c9" released by "_delete_snapshot" :: held 1.492s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:57 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-01af8d46-9f22-474c-bebb-4f6e6a93d29b" released by "delete_snapshot" :: held 1.514s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:57 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Created reservations ['48d897f4-d461-4e39-9e46-0c0ee38fd934', '6bb2b045-41d1-40eb-950e-d641a41734fa', '634de59f-4e43-47d5-ade6-e07a3b02b29f', '82487f8c-9e15-47e8-8844-8156c527bf47'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:57 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Delete snapshot completed successfully. Nov 06 11:00:57 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-e9a5187b-a710-43a1-968a-e2f224aaa129 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-bb12d1fc-10fa-4a12-8197-d33c4b7974c9-delete_snapshot" released by "delete_snapshot" :: held 1.661s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:57 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447 1G" returned: 0 in 0.435s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:57 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b028f87-2057-432b-9402-422caed8e95c -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:57 devstack sudo[109117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b028f87-2057-432b-9402-422caed8e95c -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447 Nov 06 11:00:57 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:58 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b028f87-2057-432b-9402-422caed8e95c -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447" returned: 0 in 0.301s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:58 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447 is being set with open permissions: ugo+rw Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:58 devstack sudo[109122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447 Nov 06 11:00:58 devstack sudo[109122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-01af8d46-9f22-474c-bebb-4f6e6a93d29b-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-01af8d46-9f22-474c-bebb-4f6e6a93d29b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-quobyte-01af8d46-9f22-474c-bebb-4f6e6a93d29b" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-01af8d46-9f22-474c-bebb-4f6e6a93d29b" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47a9410-8874-471b-b196-613317d884fa]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:58 devstack sudo[109122]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447" returned: 0 in 0.271s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:58 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b Nov 06 11:00:58 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.info Nov 06 11:00:58 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:58 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:58 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.info" returned: 0 in 0.269s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:58 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.info is being set with open permissions: ugo+rw Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:58 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:58 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.info Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b" returned: 0 in 0.386s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:58 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:58 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b Nov 06 11:00:58 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:58 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.info" returned: 0 in 0.257s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:58 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-01af8d46-9f22-474c-bebb-4f6e6a93d29b" returned: 0 in 0.269s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-01af8d46-9f22-474c-bebb-4f6e6a93d29b" released by "delete_volume" :: held 0.721s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:58 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-81ffa879-282a-490f-b9f1-5d77fd4becfb tempest-ProjectMemberTests-348771717 None] Create snapshot completed successfully Nov 06 11:00:58 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Created reservations ['dfb5b2b3-e934-40ee-b3ed-fbc2463e8bf0', '8566b8fe-1e69-4bdd-b6d2-d0ea8d39204a', 'e074dd3d-bb18-45a1-bc8a-e13c725ab784', '07c9418d-7646-4841-9258-65ec9cacfdb1'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:59 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:00:59 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:00:59 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.261s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:00:59 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Deleted volume successfully. Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b027ca36-a4e3-4764-b0d8-df787d005dc9 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-01af8d46-9f22-474c-bebb-4f6e6a93d29b-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Flow 'volume_create_manager' (f5081bef-8bdb-4a46-811e-4afaa3aa316f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754cc8b2-4610-47ac-b269-81804897e6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754cc8b2-4610-47ac-b269-81804897e6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-719222523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de4862d-eb5f-454f-af3a-9e3a6755f1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b416b6708b74e878636549515cfd924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:00Z,use_quota=True,user_id='55e70369bf9e4323a22d1ab81d3cc87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba03c93-6dc4-408e-8912-237dc76b4a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba03c93-6dc4-408e-8912-237dc76b4a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb7cf35-69e3-4afa-91eb-ac90ff3c58cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb7cf35-69e3-4afa-91eb-ac90ff3c58cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3de4862d-eb5f-454f-af3a-9e3a6755f1fc', 'volume_name': 'volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f1dd64-3588-4f14-afd8-cd7277dc58b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f1dd64-3588-4f14-afd8-cd7277dc58b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d7d6c5-3f7c-439d-8713-9fb11facff83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:00:59 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Volume 3de4862d-eb5f-454f-af3a-9e3a6755f1fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc', 'volume_size': 1} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-719222523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de4862d-eb5f-454f-af3a-9e3a6755f1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b416b6708b74e878636549515cfd924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:00Z,use_quota=True,user_id='55e70369bf9e4323a22d1ab81d3cc87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Creating volume 3de4862d-eb5f-454f-af3a-9e3a6755f1fc {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:00:59 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:00:59 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:00:59 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc 1073741824 Nov 06 11:00:59 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-c5ae03c2-6842-4aa0-9c27-3aaf8f847447-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Lock "cinder-c5ae03c2-6842-4aa0-9c27-3aaf8f847447-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-5b028f87-2057-432b-9402-422caed8e95c" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-5b028f87-2057-432b-9402-422caed8e95c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-c5ae03c2-6842-4aa0-9c27-3aaf8f847447" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-c5ae03c2-6842-4aa0-9c27-3aaf8f847447" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Deleting offline snapshot c5ae03c2-6842-4aa0-9c27-3aaf8f847447 of volume 5b028f87-2057-432b-9402-422caed8e95c {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] snapshot_file for this snap is: volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed513dc-7ddf-4e12-bbca-9e609b776e47]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:00 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc 1073741824" returned: 0 in 0.485s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:00 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447 Nov 06 11:01:00 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:00 devstack sudo[109150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc Nov 06 11:01:00 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:00 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:00 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc" returned: 0 in 0.267s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447" returned: 0 in 0.383s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b028f87-2057-432b-9402-422caed8e95c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d7d6c5-3f7c-439d-8713-9fb11facff83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ab20ad-7740-4584-b06b-fd4e8f155e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7673c0-4702-4a5e-afd8-e192d564e91a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:00 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Volume volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc (3de4862d-eb5f-454f-af3a-9e3a6755f1fc): created successfully Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ab20ad-7740-4584-b06b-fd4e8f155e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:00 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Flow 'volume_create_manager' (f5081bef-8bdb-4a46-811e-4afaa3aa316f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:00 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-535fbfec-8bc5-4073-8f13-f162387e7d36 tempest-ProjectReaderTests-1799534772 None] Created volume successfully. Nov 06 11:01:00 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c Nov 06 11:01:00 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:00 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c" returned: 0 in 0.374s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:01 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447 Nov 06 11:01:01 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:01 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447" returned: 0 in 0.341s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:01 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447 Nov 06 11:01:01 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:01 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c.c5ae03c2-6842-4aa0-9c27-3aaf8f847447" returned: 0 in 0.255s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-c5ae03c2-6842-4aa0-9c27-3aaf8f847447" released by "_delete_snapshot" :: held 1.485s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-5b028f87-2057-432b-9402-422caed8e95c" released by "delete_snapshot" :: held 1.509s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:01 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Created reservations ['36635411-4578-4327-a9ce-87ca72c7484a', '29a728f2-cc7d-4b42-a17a-3429ccdcf8fa', '86f7b8e5-ab25-453a-88e8-f7b5e90fb60c', 'f1b3387e-5139-4925-a2a4-00864db73fab'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:01:01 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Delete snapshot completed successfully. Nov 06 11:01:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b8ea551d-d686-471f-ac98-92fbaf69ef67 tempest-ProjectMemberTests-348771717 None] Lock "cinder-c5ae03c2-6842-4aa0-9c27-3aaf8f847447-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] Creating offline snapshot 82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 of volume 3de4862d-eb5f-454f-af3a-9e3a6755f1fc {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:01:02 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[418debd1-e124-448a-bd0c-cd69a7d317cb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:02 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc Nov 06 11:01:02 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-5b028f87-2057-432b-9402-422caed8e95c-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Lock "cinder-5b028f87-2057-432b-9402-422caed8e95c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Acquiring lock "cinder-quobyte-5b028f87-2057-432b-9402-422caed8e95c" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-5b028f87-2057-432b-9402-422caed8e95c" acquired by "delete_volume" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:02 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18ba1e6-212e-4352-a14f-c2723a8e7eab]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:02 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc" returned: 0 in 0.397s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:02 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 1G Nov 06 11:01:02 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:02 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c Nov 06 11:01:02 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:02 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c" returned: 0 in 0.371s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:02 devstack sudo[109188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c Nov 06 11:01:02 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:02 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 1G" returned: 0 in 0.437s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:02 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 Nov 06 11:01:02 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:03 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-5b028f87-2057-432b-9402-422caed8e95c" returned: 0 in 0.281s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Lock "cinder-quobyte-5b028f87-2057-432b-9402-422caed8e95c" released by "delete_volume" :: held 0.719s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Created reservations ['2b78375b-fddf-4067-b02d-e8d2cfe53bb7', '602abbd3-39df-457a-9186-a0728a0e3e32', 'dfb3461f-c194-4837-92dc-4078a781529c', '141c2a04-8b2e-4e14-a77e-43d409315032'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:03 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:03 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:01:03 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7" returned: 0 in 0.351s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:03 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 is being set with open permissions: ugo+rw Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:03 devstack sudo[109233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 Nov 06 11:01:03 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:03 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:03 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.323s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7" returned: 0 in 0.295s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:03 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Deleted volume successfully. Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e856c1c-e4f8-415e-a011-27fefcc5f1c5 tempest-ProjectMemberTests-348771717 None] Lock "cinder-5b028f87-2057-432b-9402-422caed8e95c-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:03 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.info Nov 06 11:01:03 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:03 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.info" returned: 0 in 0.262s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:03 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.info is being set with open permissions: ugo+rw Nov 06 11:01:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:03 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.info Nov 06 11:01:03 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:04 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.info" returned: 0 in 0.254s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:04 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-59db40a8-846e-4288-9fb0-040f8bbcb179 tempest-ProjectReaderTests-1799534772 None] Create snapshot completed successfully Nov 06 11:01:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Lock "cinder-82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-quobyte-3de4862d-eb5f-454f-af3a-9e3a6755f1fc" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-3de4862d-eb5f-454f-af3a-9e3a6755f1fc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-quobyte-82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Deleting offline snapshot 82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 of volume 3de4862d-eb5f-454f-af3a-9e3a6755f1fc {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:01:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] snapshot_file for this snap is: volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:01:05 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74aa38e-edb5-4485-aef4-4b15821d69bb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:05 devstack sudo[109245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 Nov 06 11:01:05 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:05 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7" returned: 0 in 0.390s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:01:05 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b406560-a18b-4bec-92d7-36091bde1da0]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:05 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc Nov 06 11:01:05 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:06 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc" returned: 0 in 0.373s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:06 devstack sudo[109262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 Nov 06 11:01:06 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:06 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7" returned: 0 in 0.343s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:06 devstack sudo[109267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7 Nov 06 11:01:06 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:06 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc.82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7" returned: 0 in 0.245s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7" released by "_delete_snapshot" :: held 1.458s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-3de4862d-eb5f-454f-af3a-9e3a6755f1fc" released by "delete_snapshot" :: held 1.478s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:06 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Created reservations ['6397f793-9774-4ba7-8341-c02bfa036688', '060e0a8a-d888-4f19-ad5d-c404a5a0f84c', '1bc1620a-eb4b-46e8-93b0-4b12ed756469', '91c5ee28-a590-40ec-a1bf-2a92553dd64a'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:01:06 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Delete snapshot completed successfully. Nov 06 11:01:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-adf7ffd4-b480-43cb-9d39-18535493ccaa tempest-ProjectReaderTests-1799534772 None] Lock "cinder-82ec3e7f-f859-4f82-9a6c-3b83b18bc0f7-delete_snapshot" released by "delete_snapshot" :: held 1.618s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-3de4862d-eb5f-454f-af3a-9e3a6755f1fc-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-3de4862d-eb5f-454f-af3a-9e3a6755f1fc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-quobyte-3de4862d-eb5f-454f-af3a-9e3a6755f1fc" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-3de4862d-eb5f-454f-af3a-9e3a6755f1fc" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:07 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec6c9fd-549e-4ae3-9abc-d4280fb8b1fa]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:07 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc Nov 06 11:01:07 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:07 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc" returned: 0 in 0.354s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:07 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc Nov 06 11:01:07 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:07 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:07 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-3de4862d-eb5f-454f-af3a-9e3a6755f1fc" returned: 0 in 0.238s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:07 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-3de4862d-eb5f-454f-af3a-9e3a6755f1fc" released by "delete_volume" :: held 0.653s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:08 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Created reservations ['d9851b8e-4bed-4d59-b3c2-9795b81925c4', '364ac23d-3b7e-489b-82a3-25ed6c37aecf', 'dae502db-a492-4648-a210-6ab309aa1a2a', '19b6f324-344c-4b01-a654-76c8fe4c46c6'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:01:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:08 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:08 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:01:08 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:08 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:08 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.262s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:08 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:01:08 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Deleted volume successfully. Nov 06 11:01:08 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-56b15576-d743-4238-b450-3ce946d6cb33 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-3de4862d-eb5f-454f-af3a-9e3a6755f1fc-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:08 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Flow 'volume_create_manager' (b7990abc-a13c-4dc7-b6be-486d8ae7bf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a6344a-77ac-4e8f-8e00-f7ca221282e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a6344a-77ac-4e8f-8e00-f7ca221282e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1969195299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e45f519-fff0-40b6-87d1-ef9335d02f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b416b6708b74e878636549515cfd924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:09Z,use_quota=True,user_id='55e70369bf9e4323a22d1ab81d3cc87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461e4337-bbb3-4ba1-811c-018ef7eb291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461e4337-bbb3-4ba1-811c-018ef7eb291d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936cbd8e-fc36-4146-a922-911bfde17968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936cbd8e-fc36-4146-a922-911bfde17968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e45f519-fff0-40b6-87d1-ef9335d02f56', 'volume_name': 'volume-9e45f519-fff0-40b6-87d1-ef9335d02f56', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5dbc36-0162-4879-a118-7a6f27b15a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5dbc36-0162-4879-a118-7a6f27b15a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7642d51c-0a98-43c5-8af3-9e48fbcca549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:09 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Volume 9e45f519-fff0-40b6-87d1-ef9335d02f56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e45f519-fff0-40b6-87d1-ef9335d02f56', 'volume_size': 1} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1969195299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e45f519-fff0-40b6-87d1-ef9335d02f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b416b6708b74e878636549515cfd924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:09Z,use_quota=True,user_id='55e70369bf9e4323a22d1ab81d3cc87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Creating volume 9e45f519-fff0-40b6-87d1-ef9335d02f56 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:01:09 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:09 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 1073741824 Nov 06 11:01:09 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:09 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 1073741824" returned: 0 in 0.415s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:09 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 Nov 06 11:01:09 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:09 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56" returned: 0 in 0.239s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7642d51c-0a98-43c5-8af3-9e48fbcca549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e45f519-fff0-40b6-87d1-ef9335d02f56', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616a0b22-c71d-4812-bd01-7ee887b3b204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:09 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Volume volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 (9e45f519-fff0-40b6-87d1-ef9335d02f56): created successfully Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616a0b22-c71d-4812-bd01-7ee887b3b204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:09 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Flow 'volume_create_manager' (b7990abc-a13c-4dc7-b6be-486d8ae7bf17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:09 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d4c52947-7cc8-40dd-82ac-fd51fbc10ef1 tempest-ProjectReaderTests-1799534772 None] Created volume successfully. Nov 06 11:01:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:10 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] Creating offline snapshot 66e5d3b6-382a-4a64-9b05-31802ba4813e of volume 9e45f519-fff0-40b6-87d1-ef9335d02f56 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:01:10 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf42266-dfe9-4bc0-a266-1397598af561]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:10 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 Nov 06 11:01:10 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:10 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56" returned: 0 in 0.376s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:10 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e 1G Nov 06 11:01:10 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:10 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e 1G" returned: 0 in 0.443s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:10 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:10 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e Nov 06 11:01:10 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:11 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e" returned: 0 in 0.279s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:11 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e is being set with open permissions: ugo+rw Nov 06 11:01:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:11 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e Nov 06 11:01:11 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:11 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e" returned: 0 in 0.252s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:11 devstack sudo[109307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.info Nov 06 11:01:11 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:11 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.info" returned: 0 in 0.251s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:11 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.info is being set with open permissions: ugo+rw Nov 06 11:01:11 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:11 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.info Nov 06 11:01:11 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:12 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.info" returned: 0 in 0.261s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:12 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-40273a17-9001-4242-a1f0-af627e64b5df tempest-ProjectReaderTests-1799534772 None] Create snapshot completed successfully Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-66e5d3b6-382a-4a64-9b05-31802ba4813e-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-66e5d3b6-382a-4a64-9b05-31802ba4813e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-quobyte-9e45f519-fff0-40b6-87d1-ef9335d02f56" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-9e45f519-fff0-40b6-87d1-ef9335d02f56" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-quobyte-66e5d3b6-382a-4a64-9b05-31802ba4813e" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-66e5d3b6-382a-4a64-9b05-31802ba4813e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Deleting offline snapshot 66e5d3b6-382a-4a64-9b05-31802ba4813e of volume 9e45f519-fff0-40b6-87d1-ef9335d02f56 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] snapshot_file for this snap is: volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cfeaec-b5bf-4f3c-91b9-2f76f70e1ad1]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:12 devstack sudo[109313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e Nov 06 11:01:12 devstack sudo[109313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:12 devstack sudo[109313]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e" returned: 0 in 0.391s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e45f519-fff0-40b6-87d1-ef9335d02f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f551d766-e6a0-40c4-8803-33407b8e37bb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:12 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:12 devstack sudo[109318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 Nov 06 11:01:12 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:13 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56" returned: 0 in 0.403s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:13 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e Nov 06 11:01:13 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:13 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e" returned: 0 in 0.378s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:13 devstack sudo[109329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e Nov 06 11:01:13 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:13 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:13 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56.66e5d3b6-382a-4a64-9b05-31802ba4813e" returned: 0 in 0.267s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-66e5d3b6-382a-4a64-9b05-31802ba4813e" released by "_delete_snapshot" :: held 1.555s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-9e45f519-fff0-40b6-87d1-ef9335d02f56" released by "delete_snapshot" :: held 1.577s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:13 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Created reservations ['d9152452-276d-4711-bc2f-de0e2ac5a74b', '9618af7d-3436-428a-a896-8b34ff38bdd0', '973b11c2-4e1b-4134-a870-625da97ed274', '6797a2d7-37ad-4747-b52b-e29856eb5965'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:01:13 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Delete snapshot completed successfully. Nov 06 11:01:13 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-d973a02f-5ba6-4c8e-9a26-3d950bcde348 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-66e5d3b6-382a-4a64-9b05-31802ba4813e-delete_snapshot" released by "delete_snapshot" :: held 1.712s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-9e45f519-fff0-40b6-87d1-ef9335d02f56-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-9e45f519-fff0-40b6-87d1-ef9335d02f56-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-quobyte-9e45f519-fff0-40b6-87d1-ef9335d02f56" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:14 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-9e45f519-fff0-40b6-87d1-ef9335d02f56" acquired by "delete_volume" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:14 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd6c872-f40a-49f7-81bb-1393f5447b94]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:14 devstack sudo[109332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 Nov 06 11:01:14 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:14 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56" returned: 0 in 0.392s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:14 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:14 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56 Nov 06 11:01:14 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:15 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-9e45f519-fff0-40b6-87d1-ef9335d02f56" returned: 0 in 0.251s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:15 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-9e45f519-fff0-40b6-87d1-ef9335d02f56" released by "delete_volume" :: held 0.711s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:15 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Created reservations ['8299e2fa-e22f-4b36-99e1-855f1d9cbf3a', '31031cab-6ce0-4519-a93a-7e79ecdaf5bd', '980a1cd7-39cf-424d-9c8c-7e5742102603', 'c2b6714f-2976-4906-84d5-80856cb24d74'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:01:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:15 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:15 devstack sudo[109340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:01:15 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:15 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:15 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.255s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:15 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:01:15 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Deleted volume successfully. Nov 06 11:01:15 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5c5bbf66-84bd-4532-a960-0e03cf78a2a5 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-9e45f519-fff0-40b6-87d1-ef9335d02f56-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Flow 'volume_create_manager' (0b630f8f-8ba2-4d70-b904-51f5eabc9cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9eaa62f-8226-4cb8-a22c-148eb8f0bac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9eaa62f-8226-4cb8-a22c-148eb8f0bac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561244214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0b8036-c340-4d6a-b55f-25c90be097b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3912cc08f73f4506af827ab6456c8c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:16Z,use_quota=True,user_id='41c5a754013c4679a55a90f448b55853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a925cde1-86f5-4e56-bc29-4c5be64bdaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a925cde1-86f5-4e56-bc29-4c5be64bdaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac10d5b9-1bdd-4a4e-9722-b2af4c54ab92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac10d5b9-1bdd-4a4e-9722-b2af4c54ab92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c0b8036-c340-4d6a-b55f-25c90be097b9', 'volume_name': 'volume-6c0b8036-c340-4d6a-b55f-25c90be097b9', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41577b01-b859-49ed-9ff4-8d23596ddd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41577b01-b859-49ed-9ff4-8d23596ddd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659f0b4a-9820-4612-b650-b6aba5b5d38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:16 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Volume 6c0b8036-c340-4d6a-b55f-25c90be097b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c0b8036-c340-4d6a-b55f-25c90be097b9', 'volume_size': 1} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561244214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0b8036-c340-4d6a-b55f-25c90be097b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3912cc08f73f4506af827ab6456c8c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:16Z,use_quota=True,user_id='41c5a754013c4679a55a90f448b55853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Creating volume 6c0b8036-c340-4d6a-b55f-25c90be097b9 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:01:16 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c0b8036-c340-4d6a-b55f-25c90be097b9 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:01:16 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c0b8036-c340-4d6a-b55f-25c90be097b9 1073741824 Nov 06 11:01:16 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Flow 'volume_create_manager' (127b0a73-4726-4f57-8068-55797d2b9960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f725982-d7e9-4dc5-abb7-0d80e3027249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f725982-d7e9-4dc5-abb7-0d80e3027249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-377458043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dfef839-ed86-4578-a888-5a9cd742476c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b416b6708b74e878636549515cfd924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:16Z,use_quota=True,user_id='55e70369bf9e4323a22d1ab81d3cc87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b53c72c-906c-45b8-ad39-25d86a1f6efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b53c72c-906c-45b8-ad39-25d86a1f6efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607c6ede-51c4-4d3f-835f-ede7527aea45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607c6ede-51c4-4d3f-835f-ede7527aea45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dfef839-ed86-4578-a888-5a9cd742476c', 'volume_name': 'volume-6dfef839-ed86-4578-a888-5a9cd742476c', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49fc8371-2cc8-4d3e-9307-29a3a0507f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49fc8371-2cc8-4d3e-9307-29a3a0507f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db8b96b-a85c-4a90-937c-2727e4850dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:16 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Volume 6dfef839-ed86-4578-a888-5a9cd742476c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dfef839-ed86-4578-a888-5a9cd742476c', 'volume_size': 1} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:16 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c0b8036-c340-4d6a-b55f-25c90be097b9 1073741824" returned: 0 in 0.412s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c0b8036-c340-4d6a-b55f-25c90be097b9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:16 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c0b8036-c340-4d6a-b55f-25c90be097b9 Nov 06 11:01:16 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:16 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c0b8036-c340-4d6a-b55f-25c90be097b9" returned: 0 in 0.246s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.588s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-377458043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dfef839-ed86-4578-a888-5a9cd742476c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b416b6708b74e878636549515cfd924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:16Z,use_quota=True,user_id='55e70369bf9e4323a22d1ab81d3cc87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Creating volume 6dfef839-ed86-4578-a888-5a9cd742476c {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:01:16 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659f0b4a-9820-4612-b650-b6aba5b5d38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c0b8036-c340-4d6a-b55f-25c90be097b9', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:16 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c 1073741824 Nov 06 11:01:16 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:16 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18f5a24-cc1f-48bc-a477-275a31b15c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:16 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Volume volume-6c0b8036-c340-4d6a-b55f-25c90be097b9 (6c0b8036-c340-4d6a-b55f-25c90be097b9): created successfully Nov 06 11:01:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18f5a24-cc1f-48bc-a477-275a31b15c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Flow 'volume_create_manager' (0b630f8f-8ba2-4d70-b904-51f5eabc9cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:17 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d14d74f4-09c3-4e92-8685-e22d53b0be6c tempest-ProjectReaderTests-1017719589 None] Created volume successfully. Nov 06 11:01:17 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c 1073741824" returned: 0 in 0.414s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:17 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c Nov 06 11:01:17 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:17 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c" returned: 0 in 0.245s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:17 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:01:17 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db8b96b-a85c-4a90-937c-2727e4850dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dfef839-ed86-4578-a888-5a9cd742476c', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a53ec53-a2cf-4a9d-895b-c8ea5ad449ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:17 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Volume volume-6dfef839-ed86-4578-a888-5a9cd742476c (6dfef839-ed86-4578-a888-5a9cd742476c): created successfully Nov 06 11:01:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a53ec53-a2cf-4a9d-895b-c8ea5ad449ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:17 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Flow 'volume_create_manager' (127b0a73-4726-4f57-8068-55797d2b9960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:17 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-e63ea1b2-894a-45b5-8a60-c416f643dd83 tempest-ProjectReaderTests-1799534772 None] Created volume successfully. Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "cinder-6c0b8036-c340-4d6a-b55f-25c90be097b9-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-6c0b8036-c340-4d6a-b55f-25c90be097b9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=235,cinder:DELETE=21,cinder:SELECT=174,cinder:INSERT=69 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=247,cinder:SELECT=177,cinder:DELETE=21,cinder:INSERT=56 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "cinder-quobyte-6c0b8036-c340-4d6a-b55f-25c90be097b9" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] Creating offline snapshot 091cc698-390d-43e0-9f0e-aeeff484e652 of volume 6dfef839-ed86-4578-a888-5a9cd742476c {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-quobyte-6c0b8036-c340-4d6a-b55f-25c90be097b9" acquired by "delete_volume" :: waited 0.031s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3df9b5e-81f6-4d0a-9de1-3c82ccc81846]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[52420b87-6e4a-44fb-97f2-95e9f962cecb]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c0b8036-c340-4d6a-b55f-25c90be097b9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:18 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c Nov 06 11:01:18 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:18 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c0b8036-c340-4d6a-b55f-25c90be097b9 Nov 06 11:01:18 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:18 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c" returned: 0 in 0.368s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:18 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c0b8036-c340-4d6a-b55f-25c90be097b9" returned: 0 in 0.367s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c0b8036-c340-4d6a-b55f-25c90be097b9 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:18 devstack sudo[109371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652 1G Nov 06 11:01:18 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:18 devstack sudo[109372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c0b8036-c340-4d6a-b55f-25c90be097b9 Nov 06 11:01:18 devstack sudo[109372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:18 devstack sudo[109372]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:18 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6c0b8036-c340-4d6a-b55f-25c90be097b9" returned: 0 in 0.265s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-quobyte-6c0b8036-c340-4d6a-b55f-25c90be097b9" released by "delete_volume" :: held 0.680s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Created reservations ['0c9db66c-d65d-4a56-ba92-f8019985ec0c', '8a79d4ce-0d04-4305-8a6c-1632bff177ea', '2f645465-5385-4084-97ed-b523aeed1782', 'a57e44dd-fdbf-4b20-b4bd-2a405f36d574'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:19 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652 1G" returned: 0 in 0.430s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dfef839-ed86-4578-a888-5a9cd742476c -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:19 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:01:19 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:19 devstack sudo[109381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dfef839-ed86-4578-a888-5a9cd742476c -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652 Nov 06 11:01:19 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:19 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.261s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:01:19 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Deleted volume successfully. Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5533bbba-a33b-4b71-8fdb-617cedec4bd8 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-6c0b8036-c340-4d6a-b55f-25c90be097b9-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:19 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dfef839-ed86-4578-a888-5a9cd742476c -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652" returned: 0 in 0.325s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:19 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652 is being set with open permissions: ugo+rw Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:19 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652 Nov 06 11:01:19 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:19 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652" returned: 0 in 0.282s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:19 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.info Nov 06 11:01:19 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Flow 'volume_create_manager' (6c916c83-cee4-4753-a28a-e61485482d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1856afbd-9fdb-42a8-9ec0-e04ae0b46564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1856afbd-9fdb-42a8-9ec0-e04ae0b46564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608291632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f54069-6b32-407b-97b5-51557a9ce96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3912cc08f73f4506af827ab6456c8c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:20Z,use_quota=True,user_id='41c5a754013c4679a55a90f448b55853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9b19a6-9286-4065-9d95-436f490d2291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9b19a6-9286-4065-9d95-436f490d2291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2613ca-4888-4c06-bbe6-73c77fa8dfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2613ca-4888-4c06-bbe6-73c77fa8dfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1f54069-6b32-407b-97b5-51557a9ce96f', 'volume_name': 'volume-a1f54069-6b32-407b-97b5-51557a9ce96f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1a1130-2376-4759-92eb-57e2e924c740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1a1130-2376-4759-92eb-57e2e924c740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffbc1c5-a001-47b3-9faf-836e377f5393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:19 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Volume a1f54069-6b32-407b-97b5-51557a9ce96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1f54069-6b32-407b-97b5-51557a9ce96f', 'volume_size': 1} Nov 06 11:01:19 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:20 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.info" returned: 0 in 0.265s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:20 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.info is being set with open permissions: ugo+rw Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:20 devstack sudo[109394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.info Nov 06 11:01:20 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:20 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.info" returned: 0 in 0.249s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.349s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608291632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f54069-6b32-407b-97b5-51557a9ce96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3912cc08f73f4506af827ab6456c8c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:20Z,use_quota=True,user_id='41c5a754013c4679a55a90f448b55853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Creating volume a1f54069-6b32-407b-97b5-51557a9ce96f {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:01:20 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a1f54069-6b32-407b-97b5-51557a9ce96f 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:20 devstack sudo[109398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a1f54069-6b32-407b-97b5-51557a9ce96f 1073741824 Nov 06 11:01:20 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:20 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-d008b24b-81f6-4a08-9a3e-6e1312f65f65 tempest-ProjectReaderTests-1799534772 None] Create snapshot completed successfully Nov 06 11:01:20 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a1f54069-6b32-407b-97b5-51557a9ce96f 1073741824" returned: 0 in 0.425s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:20 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a1f54069-6b32-407b-97b5-51557a9ce96f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:20 devstack sudo[109403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a1f54069-6b32-407b-97b5-51557a9ce96f Nov 06 11:01:20 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:21 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a1f54069-6b32-407b-97b5-51557a9ce96f" returned: 0 in 0.246s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffbc1c5-a001-47b3-9faf-836e377f5393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f54069-6b32-407b-97b5-51557a9ce96f', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a865ed0-07c4-4cb8-abf6-e0163ca2dbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:21 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Volume volume-a1f54069-6b32-407b-97b5-51557a9ce96f (a1f54069-6b32-407b-97b5-51557a9ce96f): created successfully Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a865ed0-07c4-4cb8-abf6-e0163ca2dbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Flow 'volume_create_manager' (6c916c83-cee4-4753-a28a-e61485482d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:21 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-0ed3c5b7-d101-49a9-8099-ad87abecb851 tempest-ProjectReaderTests-1017719589 None] Created volume successfully. Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-091cc698-390d-43e0-9f0e-aeeff484e652-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-091cc698-390d-43e0-9f0e-aeeff484e652-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-quobyte-6dfef839-ed86-4578-a888-5a9cd742476c" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-6dfef839-ed86-4578-a888-5a9cd742476c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-quobyte-091cc698-390d-43e0-9f0e-aeeff484e652" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-091cc698-390d-43e0-9f0e-aeeff484e652" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Deleting offline snapshot 091cc698-390d-43e0-9f0e-aeeff484e652 of volume 6dfef839-ed86-4578-a888-5a9cd742476c {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] snapshot_file for this snap is: volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c766cc4a-a564-433d-8ee5-2213fb3877a4]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:21 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652 Nov 06 11:01:21 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:21 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652" returned: 0 in 0.360s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dfef839-ed86-4578-a888-5a9cd742476c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0439b2-1bab-473b-b6c8-901fba86cf39]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:21 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "cinder-a1f54069-6b32-407b-97b5-51557a9ce96f-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:22 devstack sudo[109411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c Nov 06 11:01:22 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-a1f54069-6b32-407b-97b5-51557a9ce96f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "cinder-quobyte-a1f54069-6b32-407b-97b5-51557a9ce96f" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-quobyte-a1f54069-6b32-407b-97b5-51557a9ce96f" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9620c75-9f46-4bb4-b8fe-50118e5cb88c]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a1f54069-6b32-407b-97b5-51557a9ce96f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:22 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a1f54069-6b32-407b-97b5-51557a9ce96f Nov 06 11:01:22 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:22 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c" returned: 0 in 0.366s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:22 devstack sudo[109418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652 Nov 06 11:01:22 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:22 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a1f54069-6b32-407b-97b5-51557a9ce96f" returned: 0 in 0.392s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a1f54069-6b32-407b-97b5-51557a9ce96f {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:22 devstack sudo[109426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a1f54069-6b32-407b-97b5-51557a9ce96f Nov 06 11:01:22 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:22 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652" returned: 0 in 0.328s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:22 devstack sudo[109428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652 Nov 06 11:01:22 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:22 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-a1f54069-6b32-407b-97b5-51557a9ce96f" returned: 0 in 0.244s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-quobyte-a1f54069-6b32-407b-97b5-51557a9ce96f" released by "delete_volume" :: held 0.682s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Created reservations ['7faf190f-5c41-4fda-8a36-bcb3bffc7e3d', 'c1f466b7-a87d-4bfb-8f0b-9d0e53f36e5a', 'a5309691-002f-46e1-8cf7-87d9a92a603b', '81cbb406-3a9a-404f-82d6-461af408c46c'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:01:22 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c.091cc698-390d-43e0-9f0e-aeeff484e652" returned: 0 in 0.254s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-091cc698-390d-43e0-9f0e-aeeff484e652" released by "_delete_snapshot" :: held 1.416s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-6dfef839-ed86-4578-a888-5a9cd742476c" released by "delete_snapshot" :: held 1.446s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:22 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:22 devstack sudo[109432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:01:22 devstack sudo[109432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Created reservations ['48bec9ad-fa6d-4f2d-82a4-9863eec07f9e', 'd6784c46-1673-4e4f-b019-eb9426822e05', '405e89c4-9cf2-455a-bd60-f23813e74271', 'd9a9fb5a-130b-4242-aec3-01268fa97b90'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:01:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Delete snapshot completed successfully. Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-08e468ab-5b59-4ba6-a757-55b491999a97 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-091cc698-390d-43e0-9f0e-aeeff484e652-delete_snapshot" released by "delete_snapshot" :: held 1.617s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:23 devstack sudo[109432]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.256s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:01:23 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Deleted volume successfully. Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-cbdd6134-2e09-4782-85e1-aaac52bbd5e5 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-a1f54069-6b32-407b-97b5-51557a9ce96f-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-6dfef839-ed86-4578-a888-5a9cd742476c-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-6dfef839-ed86-4578-a888-5a9cd742476c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Flow 'volume_create_manager' (39cd4ced-819e-4881-a6e2-bbe2d3c48a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403abb21-8e9f-464a-8567-3f056c810c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403abb21-8e9f-464a-8567-3f056c810c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-31326304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27936ce6-f730-41d9-ab9f-6e0371ce3070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3912cc08f73f4506af827ab6456c8c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:24Z,use_quota=True,user_id='41c5a754013c4679a55a90f448b55853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a078937-5f67-4ef4-997b-f4c4d2750456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a078937-5f67-4ef4-997b-f4c4d2750456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e7d1be-c948-4943-ba49-ad351fe78786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e7d1be-c948-4943-ba49-ad351fe78786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27936ce6-f730-41d9-ab9f-6e0371ce3070', 'volume_name': 'volume-27936ce6-f730-41d9-ab9f-6e0371ce3070', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecc4ec2-fd44-4efc-9f39-5150791b4ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecc4ec2-fd44-4efc-9f39-5150791b4ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ba657c-28d7-4be8-9576-f84e125560cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:23 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Volume 27936ce6-f730-41d9-ab9f-6e0371ce3070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27936ce6-f730-41d9-ab9f-6e0371ce3070', 'volume_size': 1} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-31326304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27936ce6-f730-41d9-ab9f-6e0371ce3070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3912cc08f73f4506af827ab6456c8c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:24Z,use_quota=True,user_id='41c5a754013c4679a55a90f448b55853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Creating volume 27936ce6-f730-41d9-ab9f-6e0371ce3070 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:01:23 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-27936ce6-f730-41d9-ab9f-6e0371ce3070 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:23 devstack sudo[109435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-27936ce6-f730-41d9-ab9f-6e0371ce3070 1073741824 Nov 06 11:01:23 devstack sudo[109435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "cinder-quobyte-6dfef839-ed86-4578-a888-5a9cd742476c" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-6dfef839-ed86-4578-a888-5a9cd742476c" acquired by "delete_volume" :: waited 0.018s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bbcaa8-9806-4e6f-8d93-9393d2f9539d]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:23 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:23 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c Nov 06 11:01:23 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:24 devstack sudo[109435]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-27936ce6-f730-41d9-ab9f-6e0371ce3070 1073741824" returned: 0 in 0.418s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-27936ce6-f730-41d9-ab9f-6e0371ce3070 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:24 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c" returned: 0 in 0.389s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:24 devstack sudo[109445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-27936ce6-f730-41d9-ab9f-6e0371ce3070 Nov 06 11:01:24 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:24 devstack sudo[109447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c Nov 06 11:01:24 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:24 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-27936ce6-f730-41d9-ab9f-6e0371ce3070" returned: 0 in 0.244s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ba657c-28d7-4be8-9576-f84e125560cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27936ce6-f730-41d9-ab9f-6e0371ce3070', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96422b9d-d550-4cc3-ac5e-ed9e20adcf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:24 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Volume volume-27936ce6-f730-41d9-ab9f-6e0371ce3070 (27936ce6-f730-41d9-ab9f-6e0371ce3070): created successfully Nov 06 11:01:24 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96422b9d-d550-4cc3-ac5e-ed9e20adcf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Flow 'volume_create_manager' (39cd4ced-819e-4881-a6e2-bbe2d3c48a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-6dfef839-ed86-4578-a888-5a9cd742476c" returned: 0 in 0.267s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-quobyte-6dfef839-ed86-4578-a888-5a9cd742476c" released by "delete_volume" :: held 0.712s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:24 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-058fa462-5d19-43f2-9c1d-e7a36e13b08f tempest-ProjectReaderTests-1017719589 None] Created volume successfully. Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Created reservations ['78f70ff3-6bb2-40a0-927d-c6cf04cbca10', 'eb50a32b-68dc-444e-8597-ece26574bb3d', 'efe72d15-1e85-4ae6-a241-5cd7e8e0aaa4', '178b8060-1f91-49f2-9593-048fff66bdd7'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:24 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:01:24 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "cinder-27936ce6-f730-41d9-ab9f-6e0371ce3070-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-27936ce6-f730-41d9-ab9f-6e0371ce3070-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "cinder-quobyte-27936ce6-f730-41d9-ab9f-6e0371ce3070" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-quobyte-27936ce6-f730-41d9-ab9f-6e0371ce3070" acquired by "delete_volume" :: waited 0.015s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e20c10-b58e-4fdf-a6d1-6b4cfa19641a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-27936ce6-f730-41d9-ab9f-6e0371ce3070 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:24 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.301s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:01:24 devstack sudo[109453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-27936ce6-f730-41d9-ab9f-6e0371ce3070 Nov 06 11:01:24 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:24 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Deleted volume successfully. Nov 06 11:01:24 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-03185175-7aa8-4a6e-93b1-40dbbc8a48f1 tempest-ProjectReaderTests-1799534772 None] Lock "cinder-6dfef839-ed86-4578-a888-5a9cd742476c-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:25 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-27936ce6-f730-41d9-ab9f-6e0371ce3070" returned: 0 in 0.403s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-27936ce6-f730-41d9-ab9f-6e0371ce3070 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:25 devstack sudo[109459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-27936ce6-f730-41d9-ab9f-6e0371ce3070 Nov 06 11:01:25 devstack sudo[109459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:25 devstack sudo[109459]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-27936ce6-f730-41d9-ab9f-6e0371ce3070" returned: 0 in 0.263s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:25 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-quobyte-27936ce6-f730-41d9-ab9f-6e0371ce3070" released by "delete_volume" :: held 0.719s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:25 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Created reservations ['cffc1eea-b23d-493c-b9cb-e5a2092f0ac4', '4bc2e9af-3361-4dd7-98f9-a9a5f061e397', '76759bf1-fa37-4126-94ef-6e59861274fd', '3a716e2d-6efb-4eb4-ba58-06fd8f9e52be'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:01:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:25 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:25 devstack sudo[109463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:01:25 devstack sudo[109463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:25 devstack sudo[109463]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:25 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.289s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:25 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:01:25 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Deleted volume successfully. Nov 06 11:01:25 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-204c27f0-761a-45ea-816f-6436fef16eb2 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-27936ce6-f730-41d9-ab9f-6e0371ce3070-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Flow 'volume_create_manager' (d990af24-ffbf-4a71-bab7-30f3ea4bcf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27bca6d-e9d4-47b6-a837-3bd09b837bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27bca6d-e9d4-47b6-a837-3bd09b837bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-321873569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978769a4-7086-48bd-aaf4-4826be8ed36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3912cc08f73f4506af827ab6456c8c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:26Z,use_quota=True,user_id='41c5a754013c4679a55a90f448b55853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0268e768-274e-4fc9-aaef-2acff1e7b8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0268e768-274e-4fc9-aaef-2acff1e7b8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa4563b-d195-44c4-815a-95b173c4c005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa4563b-d195-44c4-815a-95b173c4c005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '978769a4-7086-48bd-aaf4-4826be8ed36b', 'volume_name': 'volume-978769a4-7086-48bd-aaf4-4826be8ed36b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f642f0-03f7-4ce0-9fd2-89b9ce772a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f642f0-03f7-4ce0-9fd2-89b9ce772a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde5c133-cb6e-4ecf-bcf2-f84f518476b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:26 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Volume 978769a4-7086-48bd-aaf4-4826be8ed36b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-978769a4-7086-48bd-aaf4-4826be8ed36b', 'volume_size': 1} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-321873569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978769a4-7086-48bd-aaf4-4826be8ed36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3912cc08f73f4506af827ab6456c8c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:26Z,use_quota=True,user_id='41c5a754013c4679a55a90f448b55853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Creating volume 978769a4-7086-48bd-aaf4-4826be8ed36b {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:01:26 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-978769a4-7086-48bd-aaf4-4826be8ed36b 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:26 devstack sudo[109466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-978769a4-7086-48bd-aaf4-4826be8ed36b 1073741824 Nov 06 11:01:26 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:26 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-978769a4-7086-48bd-aaf4-4826be8ed36b 1073741824" returned: 0 in 0.444s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:26 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-978769a4-7086-48bd-aaf4-4826be8ed36b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:26 devstack sudo[109472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-978769a4-7086-48bd-aaf4-4826be8ed36b Nov 06 11:01:26 devstack sudo[109472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:27 devstack sudo[109472]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-978769a4-7086-48bd-aaf4-4826be8ed36b" returned: 0 in 0.255s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:27 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:01:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde5c133-cb6e-4ecf-bcf2-f84f518476b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-978769a4-7086-48bd-aaf4-4826be8ed36b', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c915ae1c-23af-4b9f-9d81-2e2f545e6497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:27 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Volume volume-978769a4-7086-48bd-aaf4-4826be8ed36b (978769a4-7086-48bd-aaf4-4826be8ed36b): created successfully Nov 06 11:01:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c915ae1c-23af-4b9f-9d81-2e2f545e6497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:27 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Flow 'volume_create_manager' (d990af24-ffbf-4a71-bab7-30f3ea4bcf70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:27 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-cc186361-42ca-4610-80c0-29e491b44615 tempest-ProjectReaderTests-1017719589 None] Created volume successfully. Nov 06 11:01:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "cinder-978769a4-7086-48bd-aaf4-4826be8ed36b-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-978769a4-7086-48bd-aaf4-4826be8ed36b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "cinder-quobyte-978769a4-7086-48bd-aaf4-4826be8ed36b" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:27 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-quobyte-978769a4-7086-48bd-aaf4-4826be8ed36b" acquired by "delete_volume" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:27 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e16eef9-9c65-472e-9543-8d4c7e6cb50a]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-978769a4-7086-48bd-aaf4-4826be8ed36b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:27 devstack sudo[109475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-978769a4-7086-48bd-aaf4-4826be8ed36b Nov 06 11:01:27 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:27 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-978769a4-7086-48bd-aaf4-4826be8ed36b" returned: 0 in 0.376s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:27 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-978769a4-7086-48bd-aaf4-4826be8ed36b {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:27 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-978769a4-7086-48bd-aaf4-4826be8ed36b Nov 06 11:01:27 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:28 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-978769a4-7086-48bd-aaf4-4826be8ed36b" returned: 0 in 0.275s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-quobyte-978769a4-7086-48bd-aaf4-4826be8ed36b" released by "delete_volume" :: held 0.699s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:28 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Created reservations ['b5fb359d-ce1e-402a-b2de-d13e2068c424', '13c24b5c-ca7c-4ae9-b9b1-9136c4166490', 'cb861f73-dbda-4a80-8ef1-15b808673724', '87df0502-1916-4570-918d-8bdcafef20b6'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:01:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:28 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:28 devstack sudo[109483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:01:28 devstack sudo[109483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:28 devstack sudo[109483]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:28 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.245s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:28 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:01:28 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Deleted volume successfully. Nov 06 11:01:28 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-91ea9756-d115-4259-8141-81c70d6314d6 tempest-ProjectReaderTests-1017719589 None] Lock "cinder-978769a4-7086-48bd-aaf4-4826be8ed36b-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:01:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:01:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:36 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:36 devstack sudo[109487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:01:36 devstack sudo[109487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:36 devstack sudo[109487]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:36 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.245s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:36 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:01:36 devstack cinder-volume[86819]: DEBUG oslo_service.periodic_task [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] Running periodic task VolumeManager._thread_info {{(pid=86819) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:01:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread count: 29 {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 11:01:36 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-1e3e47cc-5cc8-461b-ac63-ad2a82602104 None None] thread info: [<_MainThread(MainThread, started 125601591468160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86819) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:01:38 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=40,cinder:UPDATE=59,cinder:INSERT=13,cinder:DELETE=6 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:01:38 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=35,cinder:INSERT=15,cinder:UPDATE=52,cinder:DELETE=3 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Flow 'volume_create_manager' (97dfe93e-c6aa-4bee-bc82-18c27d8fde64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c1ff25-a31f-4525-862b-bb667e88dd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c1ff25-a31f-4525-862b-bb667e88dd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1724971480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782954a9-698e-47bf-a286-078f6f668675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c0b16622864b9dba326ed50988a4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:51Z,use_quota=True,user_id='97f415b42a7e4a28ae166a5ce82154b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e80e9a5-ab60-47b4-a57c-a8f716b46935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e80e9a5-ab60-47b4-a57c-a8f716b46935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6e05ef-d28e-40be-9b9f-1e08b1d42437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6e05ef-d28e-40be-9b9f-1e08b1d42437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '782954a9-698e-47bf-a286-078f6f668675', 'volume_name': 'volume-782954a9-698e-47bf-a286-078f6f668675', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f062368d-8768-4c32-8bd8-34b5b1f11143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f062368d-8768-4c32-8bd8-34b5b1f11143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a4f779f-b0f2-4f22-8adc-130c2cfdc116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:50 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Volume 782954a9-698e-47bf-a286-078f6f668675: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-782954a9-698e-47bf-a286-078f6f668675', 'volume_size': 1} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1724971480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782954a9-698e-47bf-a286-078f6f668675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c0b16622864b9dba326ed50988a4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:51Z,use_quota=True,user_id='97f415b42a7e4a28ae166a5ce82154b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)}" {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Creating volume 782954a9-698e-47bf-a286-078f6f668675 {{(pid=86819) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:01:50 devstack cinder-volume[86819]: INFO cinder.volume.drivers.remotefs [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] casted to osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 Nov 06 11:01:50 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 1073741824 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:50 devstack sudo[109493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 1073741824 Nov 06 11:01:50 devstack sudo[109493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:51 devstack sudo[109493]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 1073741824" returned: 0 in 0.410s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:51 devstack sudo[109498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 Nov 06 11:01:51 devstack sudo[109498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:51 devstack sudo[109498]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675" returned: 0 in 0.242s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'} {{(pid=86819) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:01:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a4f779f-b0f2-4f22-8adc-130c2cfdc116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782954a9-698e-47bf-a286-078f6f668675', 'volume_size': 1}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a838f7-8749-4081-831a-e8e122d41446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:51 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Volume volume-782954a9-698e-47bf-a286-078f6f668675 (782954a9-698e-47bf-a286-078f6f668675): created successfully Nov 06 11:01:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a838f7-8749-4081-831a-e8e122d41446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:51 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Flow 'volume_create_manager' (97dfe93e-c6aa-4bee-bc82-18c27d8fde64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:51 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-759e3634-d443-48fe-bab5-8ddb6b1909d9 tempest-SnapshotDependencyTests-1216618527 None] Created volume successfully. Nov 06 11:01:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:51 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] Creating offline snapshot c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a of volume 782954a9-698e-47bf-a286-078f6f668675 {{(pid=86819) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:01:51 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8018e0-b269-4b0f-98dc-2248aea6ed02]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:51 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:51 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 Nov 06 11:01:51 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:52 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675" returned: 0 in 0.355s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a 1G {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:52 devstack sudo[109506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a 1G Nov 06 11:01:52 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:52 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a 1G" returned: 0 in 0.388s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-782954a9-698e-47bf-a286-078f6f668675 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:52 devstack sudo[109512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-782954a9-698e-47bf-a286-078f6f668675 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a Nov 06 11:01:52 devstack sudo[109512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:52 devstack sudo[109512]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-782954a9-698e-47bf-a286-078f6f668675 -F qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a" returned: 0 in 0.289s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:52 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a is being set with open permissions: ugo+rw Nov 06 11:01:52 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:52 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a Nov 06 11:01:52 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:53 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a" returned: 0 in 0.235s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:53 devstack sudo[109520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.info Nov 06 11:01:53 devstack sudo[109520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:53 devstack sudo[109520]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.info" returned: 0 in 0.247s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:53 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.info is being set with open permissions: ugo+rw Nov 06 11:01:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.info {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:53 devstack sudo[109523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.info Nov 06 11:01:53 devstack sudo[109523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:53 devstack sudo[109523]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.info" returned: 0 in 0.240s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:53 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.849s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:53 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-814d303d-7a77-4f71-bd28-0045ec70b5f7 tempest-SnapshotDependencyTests-1216618527 None] Create snapshot completed successfully Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.flows.manager.create_volume [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86819) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Flow 'volume_create_manager' (9b1f3183-9ce0-4cd7-905a-41d76d4e19d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f608ad2a-9b1a-4e19-a798-db6e0dc05fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f608ad2a-9b1a-4e19-a798-db6e0dc05fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da1fe314-b55a-4d26-b61f-216745c55f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c0b16622864b9dba326ed50988a4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:01:54Z,use_quota=True,user_id='97f415b42a7e4a28ae166a5ce82154b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d167118-15cd-4f81-9f78-0da17e475fa9),volume_type_id=2d167118-15cd-4f81-9f78-0da17e475fa9)' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91fe3f7-d962-4cdb-b483-9c6091e9f170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91fe3f7-d962-4cdb-b483-9c6091e9f170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbfd913-1f82-46ef-8661-6bc2d3122c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbfd913-1f82-46ef-8661-6bc2d3122c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'da1fe314-b55a-4d26-b61f-216745c55f39', 'volume_name': 'volume-da1fe314-b55a-4d26-b61f-216745c55f39', 'volume_size': 1, 'snapshot_id': 'c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56fa3a1-1714-4c6a-9ab2-b0860871c265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56fa3a1-1714-4c6a-9ab2-b0860871c265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59c5b3b-c508-4239-8780-4c97201afb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:01:54 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Volume da1fe314-b55a-4d26-b61f-216745c55f39: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-da1fe314-b55a-4d26-b61f-216745c55f39', 'volume_size': 1, 'snapshot_id': 'c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a'} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "cinder-quobyte-c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a-da1fe314-b55a-4d26-b61f-216745c55f39" by "_create_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-quobyte-c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a-da1fe314-b55a-4d26-b61f-216745c55f39" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Creating volume da1fe314-b55a-4d26-b61f-216745c55f39 from snapshot c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a {{(pid=86819) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Selected osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049 as target Quobyte volume. {{(pid=86819) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "cinder-quobyte-da1fe314-b55a-4d26-b61f-216745c55f39" by "_copy_volume_from_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-quobyte-da1fe314-b55a-4d26-b61f-216745c55f39" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] snapshot: c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a, volume: da1fe314-b55a-4d26-b61f-216745c55f39, {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd37a42a-758f-4801-8dcf-84120b842c04]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:54 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:54 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a Nov 06 11:01:54 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:55 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a" returned: 0 in 0.350s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-782954a9-698e-47bf-a286-078f6f668675(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:01:55 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ad8e5b-af49-45f4-a287-a67619bbdc64]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:01:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:55 devstack sudo[109531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 Nov 06 11:01:55 devstack sudo[109531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:01:55 devstack sudo[109531]: pam_unix(sudo:session): session closed for user root Nov 06 11:01:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675" returned: 0 in 0.353s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:01:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] will copy from snapshot at /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 11:01:55 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Creating direct copy from snapshot {{(pid=86819) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 11:01:55 devstack cinder-volume[86819]: DEBUG cinder.utils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Path /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da1fe314-b55a-4d26-b61f-216745c55f39 not found in is_blk_device check {{(pid=86819) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 11:01:55 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da1fe314-b55a-4d26-b61f-216745c55f39 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:01:55 devstack sudo[109536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da1fe314-b55a-4d26-b61f-216745c55f39 Nov 06 11:01:55 devstack sudo[109536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:02:01 devstack sudo[109536]: pam_unix(sudo:session): session closed for user root Nov 06 11:02:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da1fe314-b55a-4d26-b61f-216745c55f39" returned: 0 in 5.885s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:02:01 devstack cinder-volume[86819]: DEBUG cinder.image.image_utils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Image conversion details: src /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da1fe314-b55a-4d26-b61f-216745c55f39 {{(pid=86819) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 11:02:01 devstack cinder-volume[86819]: INFO cinder.image.image_utils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Converted 1024.00 MB image at 173.95 MB/s Nov 06 11:02:01 devstack cinder-volume[86819]: WARNING cinder.volume.drivers.remotefs [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da1fe314-b55a-4d26-b61f-216745c55f39 is being set with open permissions: ugo+rw Nov 06 11:02:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da1fe314-b55a-4d26-b61f-216745c55f39 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:02:01 devstack sudo[109551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da1fe314-b55a-4d26-b61f-216745c55f39 Nov 06 11:02:01 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:02:01 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root Nov 06 11:02:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da1fe314-b55a-4d26-b61f-216745c55f39" returned: 0 in 0.239s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:02:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-quobyte-da1fe314-b55a-4d26-b61f-216745c55f39" released by "_copy_volume_from_snapshot" :: held 6.907s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:02:01 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-quobyte-c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a-da1fe314-b55a-4d26-b61f-216745c55f39" released by "_create_volume_from_snapshot" :: held 6.963s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:02:01 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.978s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:02:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59c5b3b-c508-4239-8780-4c97201afb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da1fe314-b55a-4d26-b61f-216745c55f39', 'volume_size': 1, 'snapshot_id': 'c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a'}' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:02:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f525e3-1b09-4b87-b42a-917cc739678d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:02:01 devstack cinder-volume[86819]: INFO cinder.volume.flows.manager.create_volume [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Volume volume-da1fe314-b55a-4d26-b61f-216745c55f39 (da1fe314-b55a-4d26-b61f-216745c55f39): created successfully Nov 06 11:02:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f525e3-1b09-4b87-b42a-917cc739678d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86819) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:02:01 devstack cinder-volume[86819]: DEBUG cinder.volume.manager [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Flow 'volume_create_manager' (9b1f3183-9ce0-4cd7-905a-41d76d4e19d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86819) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:02:01 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-2893fb43-7c92-42bc-aeb6-f9a33e3cb118 tempest-SnapshotDependencyTests-1216618527 None] Created volume successfully. Nov 06 11:02:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "cinder-c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a-delete_snapshot" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:02:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:02:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "cinder-quobyte-782954a9-698e-47bf-a286-078f6f668675" by "delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:02:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-quobyte-782954a9-698e-47bf-a286-078f6f668675" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:02:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "cinder-quobyte-c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a" by "_delete_snapshot" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:02:02 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-quobyte-c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:02:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Deleting offline snapshot c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a of volume 782954a9-698e-47bf-a286-078f6f668675 {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:02:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] snapshot_file for this snap is: volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a {{(pid=86819) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:02:02 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac396464-db3f-40dc-acdc-d59b6705be44]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:02:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:02:02 devstack sudo[109556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a Nov 06 11:02:02 devstack sudo[109556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:02:02 devstack sudo[109556]: pam_unix(sudo:session): session closed for user root Nov 06 11:02:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a" returned: 0 in 0.346s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:02:02 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.remotefs [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-782954a9-698e-47bf-a286-078f6f668675(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86819) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:02:02 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4f01da-b5d0-4744-9130-9d6fbb3c37e7]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:02:02 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:02:02 devstack sudo[109562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 Nov 06 11:02:02 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:02:03 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root Nov 06 11:02:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675" returned: 0 in 0.516s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:02:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:02:03 devstack sudo[109567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a Nov 06 11:02:03 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:02:03 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root Nov 06 11:02:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a" returned: 0 in 0.318s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:02:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:02:03 devstack sudo[109572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a Nov 06 11:02:03 devstack sudo[109572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:02:03 devstack sudo[109572]: pam_unix(sudo:session): session closed for user root Nov 06 11:02:03 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675.c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a" returned: 0 in 0.258s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:02:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-quobyte-c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a" released by "_delete_snapshot" :: held 1.541s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:02:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-quobyte-782954a9-698e-47bf-a286-078f6f668675" released by "delete_snapshot" :: held 1.561s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:02:03 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Created reservations ['5b4fb205-2f02-4497-83b9-0f19a1a64734', 'ea5e6c57-1c6e-4a7e-9dad-403b4d015844', '2e73ef7b-a9b6-40c4-be9a-58faa731f2af', '1a6c9767-97a4-477c-afed-474a6d4a8d35'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:02:03 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Delete snapshot completed successfully. Nov 06 11:02:03 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-b6d07c04-ff21-431b-90c9-4b7c25a8b748 tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-c3a9c59e-1769-4ca5-b7e8-da6bbc0ca41a-delete_snapshot" released by "delete_snapshot" :: held 1.701s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:02:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "cinder-782954a9-698e-47bf-a286-078f6f668675-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:02:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-782954a9-698e-47bf-a286-078f6f668675-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:02:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "cinder-quobyte-782954a9-698e-47bf-a286-078f6f668675" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:02:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-quobyte-782954a9-698e-47bf-a286-078f6f668675" acquired by "delete_volume" :: waited 0.014s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:02:04 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[c711d57c-8952-4d77-93f4-b5f90048e6c9]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:02:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:02:04 devstack sudo[109611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 Nov 06 11:02:04 devstack sudo[109611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:02:04 devstack sudo[109611]: pam_unix(sudo:session): session closed for user root Nov 06 11:02:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675" returned: 0 in 0.356s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:02:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:02:04 devstack sudo[109616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675 Nov 06 11:02:04 devstack sudo[109616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:02:04 devstack sudo[109616]: pam_unix(sudo:session): session closed for user root Nov 06 11:02:04 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-782954a9-698e-47bf-a286-078f6f668675" returned: 0 in 0.242s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:02:04 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-quobyte-782954a9-698e-47bf-a286-078f6f668675" released by "delete_volume" :: held 0.656s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:02:04 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Created reservations ['365b0b52-c877-4bc5-acb0-07b281acecc6', 'e3363577-11d7-4b14-b2be-919afbf66a28', 'e6b28dd0-434e-4c60-86b9-c26bb28112ba', '634ff289-7244-4e90-8275-23af2e46d625'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:02:05 devstack sudo[109619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:02:05 devstack sudo[109619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:02:05 devstack sudo[109619]: pam_unix(sudo:session): session closed for user root Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.240s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:02:05 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Deleted volume successfully. Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-1e215ce8-a226-4a50-bf3c-c658476ed8f8 tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-782954a9-698e-47bf-a286-078f6f668675-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "cinder-da1fe314-b55a-4d26-b61f-216745c55f39-delete_volume" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-da1fe314-b55a-4d26-b61f-216745c55f39-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "cinder-quobyte-da1fe314-b55a-4d26-b61f-216745c55f39" by "delete_volume" {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-quobyte-da1fe314-b55a-4d26-b61f-216745c55f39" acquired by "delete_volume" :: waited 0.019s {{(pid=86819) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG oslo.privsep.daemon [-] privsep: reply[982ea69c-2eb4-4732-afac-73536744da41]: (4, 'qcow2') {{(pid=88666) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da1fe314-b55a-4d26-b61f-216745c55f39 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:02:05 devstack sudo[109622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da1fe314-b55a-4d26-b61f-216745c55f39 Nov 06 11:02:05 devstack sudo[109622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:02:05 devstack sudo[109622]: pam_unix(sudo:session): session closed for user root Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da1fe314-b55a-4d26-b61f-216745c55f39" returned: 0 in 0.353s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:02:05 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da1fe314-b55a-4d26-b61f-216745c55f39 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:02:05 devstack sudo[109629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da1fe314-b55a-4d26-b61f-216745c55f39 Nov 06 11:02:05 devstack sudo[109629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:02:06 devstack sudo[109629]: pam_unix(sudo:session): session closed for user root Nov 06 11:02:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5/volume-da1fe314-b55a-4d26-b61f-216745c55f39" returned: 0 in 0.240s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:02:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-quobyte-da1fe314-b55a-4d26-b61f-216745c55f39" released by "delete_volume" :: held 0.633s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:02:06 devstack cinder-volume[86819]: DEBUG cinder.quota [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Created reservations ['13006754-25d4-484d-9e4c-fae4557aae37', '6d14332f-6f5a-4bac-b4f4-6bfc73be8a2c', '6cb8006e-dbfb-4019-b8c4-86467da74eea', '20151f54-e3fa-411c-9e45-89890a4ab9aa'] {{(pid=86819) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:02:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:02:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:02:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049': None} {{(pid=86819) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:02:06 devstack cinder-volume[86819]: DEBUG cinder.volume.drivers.quobyte [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-067551f9-2d76-4745-aa06-d5920910d049'] {{(pid=86819) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:02:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.lockutils [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86819) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:02:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:02:06 devstack sudo[109638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5 Nov 06 11:02:06 devstack sudo[109638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:02:06 devstack sudo[109638]: pam_unix(sudo:session): session closed for user root Nov 06 11:02:06 devstack cinder-volume[86819]: DEBUG oslo_concurrency.processutils [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/151567c82254e777585054e692d075a5" returned: 0 in 0.239s {{(pid=86819) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:02:06 devstack cinder-volume[86819]: DEBUG cinder.manager [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Notifying Schedulers of capabilities ... {{(pid=86819) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:02:06 devstack cinder-volume[86819]: INFO cinder.volume.manager [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Deleted volume successfully. Nov 06 11:02:06 devstack cinder-volume[86819]: DEBUG cinder.coordination [None req-5274a775-1d6f-4904-a58d-7ddc314d2d9a tempest-SnapshotDependencyTests-1216618527 None] Lock "cinder-da1fe314-b55a-4d26-b61f-216745c55f39-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86819) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:02:19 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:SELECT=29,cinder:INSERT=7,cinder:UPDATE=27,cinder:DELETE=4 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:02:19 devstack cinder-volume[86819]: DEBUG dbcounter [-] [86819] Writing DB stats cinder:UPDATE=32,cinder:SELECT=21,cinder:DELETE=1,cinder:INSERT=8 {{(pid=86819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}